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PREFACE 


Following  the  investigation  of  the  August  1987  crash 
of  Northwest  255,  the  National  Transportation  Safety 
Board  (NTSB)  concluded  that  airline  training  and  check¬ 
ing  practices  do  not  promote  effective  use  of  checklists. 
One  of  the  recommendations  the  NTSB  made  to  the 
Federal  Aviation  Administration  (FAA)  was  “to  deter¬ 
mine  if  there  is  any  type  or  method  of  presenting  checklists 
that  produce  better  performance  on  the  part  of  user  person¬ 
nel.” 

This  report  was  prepared  for  the  FAA  in  response  to 
that  recommendation.  The  document  describes  a  study  of 
current  checklist  designs  and  practices  of  Part  121  and  Part 
135  carriers.  Data  for  this  study  were  collected  through  an 
examination  of  accident/incident  reports  from  NTSB  and 
the  Aviation  Safety  Reporting  System,  manuals  and  check¬ 
lists  from  Part  121  and  Part  135  carriers,  and  a  survey  of 
airline  pilots  conducted  by  the  Air  Line  Pilots  Association 
to  assess  the  state  of  checklist  use  throughout  the  industry. 
Recommendations  include  guidelines  for  checklist  de¬ 
sign. 

This  paper  was  prepared  for  the  Biomedical  and 
Behavioral  Sciences  Branch  of  the  FAA  Office  of  Avia¬ 
tion  Medicine  by  the  Operator  Performance  and  Safety 
Analysis  Division  of  the  Office  of  Research  and  Analysis 
at  the  Volpe  National  Transportation  Systems  Center 
(TSC).  The  report  was  completed  under  the  direction  of 
TSC  Program  Manager  M.  Stephen  Huntley,  Jr.;  research 
was  the  responsibility  of  John  W.  Turner  of  EG&G 
Dynatrend,  an  on-site  contractor. 
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EXECUTIVE  SUMMARY 


Checklists  are  valuable,  even  indispensable,  tools  of 
airline  safety.  Yet  it  is  clear  that  checklists  are  being 
misused  or  ignored  in  the  industry. 

Checklist  procedures  were  not  directly  performed 
in  the  August  1987  crash  of  Northwest  255  in 
Detroit.  This  conclusion  was  made  by  the  National 
Transportation  Safety  Board  (NTSB)  after  investi¬ 
gating  the  crash.  The  NTSB  also  concluded  that 
airline  training  and  checking  practices  do  not  pro¬ 
mote  effective  use  of  checklists. 

Although  it  is  not  clear  that  checklist  design  contrib¬ 
uted  to  the  crash,  the  NTSB  recommended  as  a 
Class  II  Priority  Action  (A-88-68)  that  the  FAA  take 
steps  “...to  determine  if  there  is  any  type  or  method 
of  presenting  checklists  that  produce  better  perfor¬ 
mance  on  the  part  of  user  personnel.” 

This  study  was  undertaken  to  help  in  making  that 
determination.  We  found  that  checklists  can  indeed 
be  improved  and  have  made  recommendations  to 
that  end.  Other  recommendations  include  the  need 
for  more  training,  and  the  need  for  review  of  the 
FARs  concerned  with  checklists  and  manuals. 

This  executive  summary  describes  our  sources  of 
information,  findings,  and  recommendations. 

Sources  of  Information 

We  gathered  information  for  the  study  as  follows: 

•  Reviewed  summaries  of  NTSB  and  ASRS 
accident/incident  reports; 

•  Reviewed  selected  operator  manuals  and 
checklists  for  Part  121  and  Part  135  operators; 

•  Reviewed  results  of  a  pilot  survey  conducted 
by  the  Airiine  Pilots  Association  (ALP A) — 
this  survey  explored  pilot  use  of  checklists; 

Other  sources  included: 

•  Meetings  with  an  NTSB  investigator  and  rep¬ 
resentatives  of  two  regional  carriers; 

•  Meetings  with  the  Air  Transport  Association 
(ATA)  Flight  Crew  Checklist  Working  Group; 

•  Jumpseat  rides  on  regional  and  major  carriers 


to  observe  checklist  performance  in  an  opera¬ 
tional  setting; 

•  Visits  to  two  corporate  aviation  departments 
to  discuss  checklist  issues; 

•  Examination  of  guidelines  in  human  factors 
handbooks  and  military  specifications  (MIL 
SPECS)  concerning  the  design  cf  checklists 
and  manuals. 

Findings 

The  NTSB  report  summaries  included  the  period 
from  1/83  to  10/86.  During  this  time,  21  accidents/ 
incidents  of  multi-engine  aircraft  occurred  in  which 
a  defective  or  a  misused  checklist  was  involved.  In 
five  of  these  cases,  a  checklist  was  not  used  at  all.  (In 
17  of  these  cases,  the  aircraft  was  badly  damaged  or 
destroyed.)  The  ASRS  report  summaries  included 
1 95  reports  of  occurrences  involving  checklists  over 
the  past  five  years.  The  types  of  errors  found  in  the 
ASRS  report  summaries  were  confirmed  by  an 
ALPA  survey,  meetings  with  representatives  of 
NTSB,  ATA,  and  regional  carriers;  and  by  jumpseat 
rides  on  various  aircraft.  Corporate  on-site  visits 
provided  information  on  checklist  technology  in 
selected  applications.  The  following  problems  were 
identified: 

•  A  breakdown  in  crew  coordination  or  proce¬ 
dures  in  checklist  use  contributed  to  by  a  lack 
of  training.  There  was  also  a  lack  of  clear 
direction  to  crews  in  the  use  of  checklists  in 
many  cases. 

•  Interruptions  were  a  cause  of  checklist  misuse. 
There  were  external  interruptions  to  the  use  of 
a  checklist  by  a  flight  crew  and  operational 
tasks  being  interrupted  by  the  necessity  to  use 
a  checklist  These  findings  were  confirmed  by 
the  ALPA  survey. 

•  The  design,  organization,  and  contents  of 
checklists  and  manuals  were  often  nonstand¬ 
ard.  There  were  missing,  inconsistent,  and 
incorrect  procedures.  Checklists  were  some¬ 
times  not  in  the  order  in  which  they  were  to  be 
performed.  Items,  and  sometimes  whole  sets 
of  operationally  relevant  procedures,  were  not 
carried  over  from  Airplane  Flight  Manuals 
(AFM)  to  checklists.  Checklist  actions  sume- 
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times  were  different  from  the  required  proce¬ 
dure  in  the  AFM. 

•  Readability  varied  widely,  even  within  the 
same  company's  checklists.  Type  size  and 
clarity  were  dissimilar  and  the  need  for  guide¬ 
lines  was  apparent 

•  Color  coding  of  checklists  was  seldom  used 
although  it  could  facilitate  rinding  critical 
checklists. 

•  The  use  of  the  terms  “ABNORMAL”  and 
“EMERGENCY,”  as  they  applied  to  check¬ 
lists,  was  inconsistent  What  one  manufac¬ 
turer  might  call  an  ABNORMAL  procedure, 
another  called  an  EMERGENCY.  A  clear 
definition  of  each  term  promulgated  through¬ 
out  the  industry  might  promote  standard  use 
and  eliminate  confusion. 

•  Emergency  checklists  were  difficult  to  re¬ 
trieve  when  needed.  They  were  often  carried 
in  poorly  tabbed  manuals  in  flight  bags. 

•  Heads-down  time  is  reported  as  increasing 
with  the  use  of  checklists  on  CRTs.  This  also 
pertains  to  the  necessity  to  reprogram  cockpit 
computers  for  changes  in  flight  plans. 


RECOMMENDATIONS 
Recommendations  address  the  need  for  improved 
checklists  and  manuals  and  more  training  in  the  use 
of  checklists.  These  recommendations  are  detailed 
below. 

•  Design  guidelines  for  checklists  and  flight 
manuals  should  be  developed  as  follows  (also 
see  Appendix  A). 

Checklists 

“Normal”  checklists  should: 

•  Include  only  operationally  pertinent  items; 

•  Be  listed  in  the  order  to  be  performed; 

•  Have  safety  critical  items  such  as  gear  and 
flaps  as  final  items  listed  prior  to  takeoff  and 
landing; 


•  Have  sufficiently  large  type  with  the  neces¬ 
sary  clarity  ofprint  and  contrast  toensure good 
readability  in  all  cockpit  lighting  conditions; 

•  Includenomoreindividualcheckliststhancan 
fit  on  a  single,  easily  stowed  card. 

"Emergency”  checklists  should: 

•  Be  readily  accessible  in  cockpits; 

•  Be  available  on  a  card  as  well  as  in  a  manual; 

<mi  the  reverse  of  the  “Normal”  checklist  card, 
if  possible; 

•  Have  a  standard  order  of  presentation  for  all 
aircraft  in  acompany's  fleet,  so  that  individual 
checklists  can  be  located  easily; 

•  Haveclearvisualseparationof  checklists  with 
.  titles  in  boldface,  all  caps,  and  in  type  two 
points  larger  than  the  text,  for  easy  identifica¬ 
tion; 

•  Be  no  smaller  in  type  than  a  well-designed 
“NonnaTchecklist,  and  laigerif  space  permits; 

•  Contain  only  those  items  needed  to  combat  the 
emergency.  These  checklists  should  be  easy  to 
understand  and  execute. 

Manuals 

Procedures  specified  in  manuals  for  checklist  use 

should: 

•  Clearly  define  crew  checklist  roles  in  different 
phases  of  aircraft  operation; 

•  Require  specific  responses  wherever  the  “AS 
REQUIRED”  response  is  written;  forexample, 
“FLAPS....20°,”“ANTI  ICE....OFF(orON)”; 

•  Require  dual  response  only  to  the  highest 
priority  safety  critical  items; 

•  Require  immediate  replacement  of  checklists 
worn  to  the  point  of  reduced  readability. 

Requirements  for  the  format  of  manuals  should: 

•  Specify  a  cleariy  referenced  and  standardized 
table  of  contents; 
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•  Specify  standardized,  color-coded  tabs  for 
each  checklist  section  and  subsection  with  an 
alphabetized  index  as  the  first  page  after  the 
tab. 

•  Initial  and  recurrent  training  should  be  re¬ 
quired  in  checklist  use. 

•  Review  of  FARs  should  he  conducted  to  de- 
termine  the  need  for 

•  A  clear  definition  of  “NORMAL,”  “AB¬ 
NORMAL,”  and  "EMERGENCY”  to 
establish  uniform  checklist  classification 
by  manufacturers  and  airlines; 

♦  A  requirement  that  all  operators,  regard¬ 
less  of  size,  meet  the  same  standards  for 
manuals  and  checklists. 

Research  and  development  should  be  conducted  to: 

•  Establish  quantitative  and  behavioral  criteria 
for  checklist  accessibility  and  readability; 

•  Develop  and  evaluate  the  usefulness  of  a  stan¬ 
dard  format  organization,  and  table  of  con¬ 
tents  for  aircraft  flight  manuals; 

•  Evaluate  the  use  of  all  caps  vs.  mixed  case 
lettering  in  checklist  design; 

•  Develop  and  evaluate  the  use  of  a  standard 
terminology  for  controls,  displays,  and  in¬ 
flight  operations  in  checklists  and  flightmanu- 
als; 

•  Evaluate  the  utility,  safety  benefits,  and  limits 
of  audio  checklists,  checklists  on  CRTs,  and 
checklists  with  artificial  intelligence  features, 
both  in  a  laboratory  setting  and  in  an  opera¬ 
tional  context;  (There  is  currently  an  audio 
checklist  design  available  from  Heads-Up 
Technology  that  will  be  the  subject  of  a  study 
by  United  Airiines.) 

•  Evaluate  the  benefits  of  color  coding  and 
different  font  styles  on  checklist  readability 
for  electronic  as  well  as  paper  checklists; 

•  Evaluate  the  operational  feasibility  of  check¬ 
list  interiocks  that  would  prevent  aircraft  take¬ 
off  without  completion  of  safety  critical  items; 


•  Evaluate  the  utility,  safety  benefits,  arcl  limits 
of  mechanical  checklists  such  as  those  used  by 
American  Airiines  for“BEFORETAKEOFF” 
and  “BEFORE  LANDING."; 

•  Developandevaluateaprotoiypcchecklistfor 
Parts  135  and  121  use.  This  list  would  be 
developed  as  an  example  of  how  human  fac¬ 
tors  principles  in  the  use  of  formatting,  font 
size,  and  color  coding  can  be  applied  to  im¬ 
prove  checklist  design; 

•  Determine  the  influence  of  memory  items  on 
emergency  checklists  on  the  speed  and  accu¬ 
racy  with  which  emergency  procedures  are 
performed. 
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The  Use  and  Design  of  Flichtcrew  Checklists  and  Manuals 


1.  INTRODUCTION 

Checklists  have  been  used,  in  one  form  or  another, 
since  the  beginning  of  manned  flight,  and  certainly 
since  the  inception  of  the  airline  industry.  Even  the 
most  rudimentary  reminders  to  assure  aircraft  readi¬ 
ness  were  an  early  form  of  checklist.  With  the 
increasing  complexity  of  aircraft,  the  ability  of  the 
piloi(s)  to  accomplish  all  the  items  necessary  for 
safety  without  some  type  of  checklist  was  dimin¬ 
ished,  and  with  the  advent  of  larger  and  multi- 
engine  aircraft,  a  more  formal  checklist  became 
necessary  to  assure  completion  of  the  multitude  of 
items  to  be  checked.  However,  as  aircraft  grew 
larger  and  more  complex,  as  checklists  grew  in  size, 
and  as  traffic  increased,  interferences  to  checklist 
use  also  increased,  with  resultant  increases  in  the 
probability  that  errors  would  be  made  in  the  use  of 
checklists  and  checklist-driven  procedures.  ASRS 
reports,  data  in  NTSB  files,  pilot  reports,  and  direct 
cockpit  observations  indicate  that  checklists  can  be 
misused  easily  and  arc  sometimes  even  ignored. 
There  is  much  concern  throughout  the  industry  and 
some  empirical  support  that  such  misuse  or  lack  of 
use  has  contributed  to  the  occurrence  and  severity  of 
aircraft  accidents. 

1.1  REASON  FOR  THE  STUDY 
Following  its  investigation  of  the  crash  of  North¬ 
west  Flight  255  in  Detroit,  in  August  1987,  The 
National  Transportation  Safety  Board  concluded 
that  “...the  flight  crew  did  not  perform  the  checklist 
procedures  in  the  manner  prescribed  inthe  company’s 
Airplane  Pilot’s  Handbook.”  They  noted  that  train¬ 
ing  and  checking  practices  currently  in  use  by  the 
airlines  do  not  promote  effective  use  of  checklists. 

Although  it  is  not  clear  that  checklist  design  was  an 
important  contributor  to  the  Flight  255  crash,  the 
NTSB  did  include  among  the  seven  recommenda¬ 
tions  produced  by  their  investigation,  the  Gass  II 
priority  Action  (A-88-68)  that  the  FAA  take  steps 
“...to  determine  if  there  is  any  type  or  method  of 
presenting  checklists  that  produces  belter  perfor¬ 
mance  on  the  part  of  user  personnel.” 

The  objectives  of  this  study  were:  a)  to  identify 
conditions  that  interfere  with  cockpit  crews  execut¬ 
ing  or  verifying  normal  and  abnormal  cockpit  pro¬ 
cedures  through  the  use  of  checklists;  b)  to  deter¬ 
mine  the  need  and  nature  of  FAA  action  to  promote 


good  checklist  practices;  and  c)  to  determine  re¬ 
quirements  for  research  on  the  design  and  use  of 
cockpit  checklists. 

12  APPROACH 

The  following  processes  were  used  to  accomplish 
the  objectives  of  the  study: 

•  Determine  the  contents  and  readability  of  cur¬ 
rent  checklists  and  handbooks, 

•  Identify  operational  conditions  that  interfere 
with  checklist  use; 

•  Identify  flight  crew  practices  that  interfere 
with  checklist  use; 

•  Identify  design,  procedural,  operational,  and 
flight  crew  characteristics  that  promote  good 
checklist  use. 

13  PRODUCTS 

•  Specification  and  discussion  of  conditioas 
that  interfere  with  good  cliecklist  practices. 

•  Guidelines  for  checklist  design  and  evalua¬ 
tion. 

•  Recommendations  for  furtherstudy  in  areas  of 
checklist  design  where  more  information  is 
required. 

•  Recommcndatioas  for  changes  in  FARs  to 
promote  improved  use  and  design  of  check¬ 
lists. 

2.  METHODS 

We  used  the  following  means  of  gathering  informa¬ 
tion  for  this  study. 

2.1  NTSB  AND  ASRS  REPORT  SUMMARIES 
Relevant  NTSB  and  ASRS  acci dent/incidcnt  re¬ 
ports  were  reviewed  to  identify  conditions  that  could 
promote  the  misuse  of  checklists,  and  to  identify 
operational  errors  thatmay  liave  resulted  from  check¬ 
list  misuse. 
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2 J2  STUDY  OF  PARTS  121  AND  135  OPERA¬ 

TOR  INFORMATION 

A  sample  of  checklists  cards  and  expanded  check¬ 
lists  in  handbooks  from  prominent  Parts  121  and 
1 35  air  carriers  were  examined: 

•  To  identify  design  and  implementation  prac¬ 
tices  that  should  be  promoted; 

•  To  determine  iftherc  was  a  need  for  guidance 
in  the  design  and  implementation  of  check¬ 
lists; 

«  To  identify  design  and  implementation  issues 
that  should  be  addressed  by  research,  regula¬ 
tions,  or  recommendations  to  the  industry. 

23  ALPA  SURVEY 

The  Airline  Pilots  Association  (ALPA)  surveyed 
line  pilots  to  request  their  experiences  and  opinions 
concerning  the  checklists  they  use.  It  was  expected 
that  the  information  provided  by  this  survey  would 
indicate  the  operational  significance  of  various  char¬ 
acteristics  of  checklist  design  and  design  options, 
serve  to  identify  safely  issues  that  we  may  have 
missed  in  our  analyses,  and  identify  differences  in 
pilot  opinion  regard. ng  checklist  issues. 

2.4  ADDITIONAL  SOURCES  OF  INFORMA¬ 
TION 

•  Discussions  with  an  NTSB  investigator  and 
representatives  of  two  regional  carriers. 

•  Meetings  of  the  AT A  Flight  Crew  Checklist 
Working  Group.  This  group  was  convened  to 
provide  a  forum  between  the  FAA  group 
responsible  for  writing  the  manual  and  check¬ 
list  guidelines  for  the  Draft  Inspectors'  Hand¬ 
book  and  industry  representatives. 

•  Jumpscat  rides  cn  regional  and  major  carriers 
to  observe  use  of  checklists  by  crews,  and  to 
ascertain  conditions  that  interfere  with  check¬ 
list  use. 

•  Visits  to  two  corporate  aviation  departments 
to  discuss  checklist  technology  used  in  corpo¬ 
rate  cockpits,  and  to  elicit  opinions  on  that 
technology. 

•  Examination  of  guidelines  for  manual  and 
checklist  construction  in  human  factors  hand¬ 
books  and  military  specifications  (MIL 
SPECS). 


3.  FINDINGS  AND  DISCUSSION 

3.1  NTSB  REPORTS  SUMMARY 
From  the  beginning  of  1983  to  10/7/86,  there  were 
21  accidents/ incidents  (involving  multi-engine  air¬ 
planes)  investigated  by  the  NTSB,  in  which  the 
improper  use  of  a  checklist  or  a  defective  checklist 
was  suspected.  In  24%  (five)  of  these,  the  checklist 
was  not  used  at  all.  Of  the  remainder,  amanufacturcr’s 
checklist  was  found  to  be  inadequate  in  one  case, 
and  in  the  other  eases  the  checklists  were  not  prop¬ 
erly  followed. 

The  danger  of  checklist  misuse  is  seen  in  the  results 
of  the  accidents,  81%  (17)  of  which  resulted  in 
substantial  damage  or  destruction  of  the  aircraft.  A 
brief  summary  of  the  NTSB  investigations  follows. 

•  Detroit,  Ml,  1/1 1/83  -  United  Airlines  DC-8- 
54F  -  aircraft  destroyed  -  three  crew  fatalities 

-  improper  trim  setting  caused  loss  of  aircraft 
control  -  might  have  been  compounded  by 
unqualified  2nd  officer  occupying  1st  officer 
position  during  takeoff  -  checklist  not  fol¬ 
lowed. 

•  Bryce, UT, 4/2/83 -Republic DC-9-82 -both 
engines  flamed  out  due  to  fuel  starvation  - 
emergency  declared  -  engines  restarted  -  check¬ 
list  not  followed  due  to  distraction. 

•  Little  Rock,  AR,  4/13/83  -  Central  Flying 
Service  Beech  BE-58  -  substantial  aircraft 
damage  -  gear  up  landing  excessive  workload 
and  checklist  not  used. 

•  Luke  AFB,  AZ,  5/28/83  -  Republic  DC-9-31 

-  forced  landing  caused  by  engine  flameout 
due  to  fuel  exhaustion  -  a  tripped  fuel  quantity 
circuit  breaker  was  not  noticed  during  the 
prcflight  checklist  -  checklist  not  followed. 

•  Blountville,  TN,  10/28/83  -  Atlantic  South¬ 
east  Embraer  EMB  1 10-PI  -  substantial  air¬ 
craft  damage  -  16  minor  injuries  -  aircraft 
landed  gear  up  due  to  indication  of  one  gear 
not  down  and  locked  -  no  confirmation  made 
on  indication  problem  -  checklist  not  fol¬ 
lowed. 

•  Longview,  TX,  2/29/84  -  Mid  America  Air¬ 
ways,  Inc.  Beech  E-55  -  substantial  aircraft 
damage  -  two  minor  injuries  -  total  loss  of 
power,  forced  landing  -  took  off  on  almost 
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empty  auxiliary  fuel  tanks,  plenty  of  fuel  in 
main  tanks  -  checklist  not  followed. 

«  Grand  Island,  NE,  6/29/84  -  Pioneer  Airways, 
Inc.  Swearingen  SA  227-AC  -  minor  aircraft 
damage  -  loss  of  control  on  takeoff  roll,  struck 
runway  light  -  left  prop  on  start  locks  -  check¬ 
list  not  followed. 

•  Selawik,  AK,  10/16/84  -  Ryan  Air  Service, 
Inc,  Beech  3NM  -  substantial  aircraft  damage 
-  gear  up  landing  •  checklist  not  followed. 

•  San  Antonio,  TX,  12/24/84  -  K.  E.  Cohlima 
Beech  95-CSS  -  substantial  aircraft  damage  - 
gear  up  landing  -  checklist  not  followed. 

•  Holly  Springs,  MO,  2/8/85  -  Professional 
Aviation  Beech  58  -  substantial  aircraft  dam¬ 
age  -  gear  up  landing  -  couldn’t  lower  gear 
manually  because  the  pilot  couldn’t  unstow 
the  crank  -  checklist  not  followed. 

•  Berkeley,  MO,  2/13/85  -  Britt  Airways,  Inc. 
Swearingen  S  A  226-TC  -  both  engines  quit  on 
final  due  to  ice  ingestion  -  plane  landed  with- 
out  damage  -  nothing  on  the  checklist  concern¬ 
ing  the  use  of  auto-ignition  in  freezing  outside 
air  temperatures. 

•  Williston,  ND,  4/7/85  -  Pioneer  Airlines,  Inc. 
Swearingen  SA  227-AC  -  substantial  aircraft 
damage  -  landed  gear  up  -  improper  use  of 
checklist 

•  Potsdam,  NY,  5/17/85  -  Sair  Aviation  Piper 
PA-3 1 -350 -  substantial  aircraft  damage  -  gear 
up  landing  -  checklist  not  followed. 

•  Atlanta,  GA,  5/19/85 -Basil  Aircraft  Services 
Embraer  EMB-1 10-PI  -  substantial  aircraft 
damage  -  collision  with  parked  aircraft  on 
rollout  -  insufficient  hydraulic  brake  pressure 
due  to  incorrect  monitoring  of  warning  annun¬ 
ciator  light  and  use  of  incorrect  procedure  - 
checklist  not  used. 

•  Nashville,  TN,  5/31/85  -  General  Aviation, 
Inc.  Gulfstream  G-159  -  aircraft  destroyed  - 
two  crew  fatalities  -  lossof  control  after  engine 
loss  on  takeoff,  prop  didn’t  feather  -  H.  P.  cock 
levers  not  in  “cruise  lockout”  position  -  item 
not  done  on  checklist  before  takeoff. 


•  Dallas,  TX,  8/7/85  -  Air  Midwest,  Inc. 
Fairchild/Swearingen  SA  226-TC  -  substan¬ 
tial  aircraft  damage  -  gear  up  landing  -  could 
have  manually  extended  gear  -  didn't  use 
checklist. 

•  Orlando,  FL, 4/22/86 -Craig  Air  Center  Beech 
95-P55  -  substantial  aircraft  damage  -  gear  up 
landing  -  late  extension  of  gear,  aircraft  landed 
on  gear  doors  -  checklist  not  followed. 

•  Indianapolis,  IN,  7/9/86  -  PDQ  Air  Service 
Beech  BE-58  •  substantial  aircraft  damage  - 
gear  up  landing  -  checklist  not  used. 

•  Jacksonville,  FL,  10/7/86  -  Top  Flight,  Inc. 
Ted  Smith  Aerostar  600  -  substantial  aircraft 
damage  -  gear  up  landing  -  checklist  not  used. 

•  Santa  Barbara,  CA,  10/30/86  -  Wings  West 
Airlines,  Inc.  Fairchild/Swearingen  SA-226- 
TC  -  substantial  aircraft  damage  -  one  serious 
injury,  two  minor  injuries  -  gear  up  landing  - 
prop  fragmented  and  punctured  passenger 
compartment  -  gear  warning  hom  circuit 
breaker  deliberately  pulled  and  gear  called  for 
but  not  extended  -  checklist  not  followed. 

•  Florence,  SC,  2/5/87  -  Atlantis  Leasing,  Inc. 
Swearingen  SA-226-TC  -  substantial  aircraft 
damage  -  gear  up  landing  -  checklist  not  fol¬ 
lowed. 

In  one  of  these  cases,  the  incident  was  directly 
attributable  to  the  use  of  an  inadequate 
manufacturer’s  checklist  In  another  case,  inflight 
distractions  contributed  to  a  lack  of  conformity  to 
checklist  procedures.  One  report  cited  excessive 
workload  as  a  factor.  In  another  case,  the  NTSB 
cited  the  company  management  for  "improper  emer¬ 
gency  procedures  training”  of  its  pilots. 

Of  the  21  cases  reviewed,  20  involved  lack  of 
conformance  with  the  FARs  regarding  checklist 
use.  In  the  cases  not  involving  extenuating  circum¬ 
stances,  it  is  not  possible  to  ascertain  the  reason  for 
nonconformity  from  the  information  we  have.  But, 
the  large  proportion  of  instances  of  nonconformity 
indicates  that  this  problem  may  be  as  great  a  prob¬ 
lem  as  is  checklist  design,  if  not  greater. 
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32  ASRS  REPORTS  SUMMARY 
ASRS  reports  provide  a  rich  source  of  information 
regarding  problems  in  aviation.  They  are  submitted 
on  a  voluntary  basis  by  pilots,  controllers,  and  others 
in  the  operational  side  of  the  industry.  Because 
submissions  are  voluntary,  the  contents  of  this  data¬ 
base  should  not  be  considered  representative  enough 
for  use  in  describing  all  errors  and  problems  that 
occur  in  the  cockpit.  The  crews  report  the  problems 
that  they  want  to  report.  Nevertheless,  there  is  no 
reason  to  doubt  that  the  problems  that  are  reported 
did  in  fact  occur. 

Those  submitting  reports  are  asked  to  identify  them¬ 
selves  for  purposes  of  phone  contact  by  ASRS  for 
amplifying  information;  however,  all  reports  are 
deidentified  shortly  after  being  received.  The  re¬ 
ports  are  available  for  research  on  specific  subjects. 
We  requested  reports  on  any  occurrences  involving 
checklists  over  the  past  five  years.  We  received 
summaries  of  195  reports  that  were  relevant  to  our 
study.  A  summary  of  each  of  those  is  included  in 
Appendix  C.  The  following  shows  categories  of 
errors  made  and  gives  examples  of  each. 

•  Sixty-five  were  cases  of  checklist  items  being 

missed  or  incorrectly  performed  by  the  crew: 

-  Engine  flamed  out  at  altitude  from  fuel 
exhaustion.  Declared  an  emergency.  Crew 
had  not  turned  on  all  boost  pumps  as 
instructed  in  the  checklist 

-  Control  lock  still  installed  on  the  yoke 
during  takeoff.  Aborted  flight  40  in  the  air 
after  noticing  lack  of  control  response. 

-  Altimeter  mis-set  by  1",  not  checked  by 
crew,  altitude  overshoot  on  short  final, 
warned  by  the  GPWS. 

•  Tenhadnothingonthe*'beforelanding”check- 

list  to  accomplish  the  required  action: 

-  Aircraft  landed  with  fuel  badly  out  of 
balance  limitations,  no  item  on  the  check¬ 
list  to  check  fuel  pump  configuration. 

-  Altitude  undershoot  in  climb.  The  reset  of 
the  altimeter  at  1 8,000'  to  QNE  (the  set¬ 
ting  of  altimeters  to  29.92  at  18,000  feet 
and  above)  was  not  on  the  checklist. 

•  Eleven  involved  poorly  designed  checklists  or 


manuals: 

-  Checklist  called  for  throttle  to  be  pulled 
out  1/2"  on  start,  whether  engine  was  hot 
or  not.  On  start,  the  pilot  could  not  control 
the  plane  and  hit  the  fuel  pump  (the  throttle 
should  be  closed  for  hot-engine  starts). 

-  Altitude  overshoot  on  climbouL  Check¬ 
list  procedure  has  altimeters  reset  at  10,000 
in  the  climb  -  far  too  late  when  assigned 
altitude  is  below  that 

•  Six  had  no  checklist  to  use: 

-  Aircraft  failed  to  pressurize  because  nei¬ 
ther  air  conditioning  pack  was  function¬ 
ing.  No  abnormal  checklist  was  available 
to  cover  that  condition  (this  was  on  a  wide 
body  airplane). 

-  Aircraft  landed  gcarup.  No  checklist,  and 
the  pilot  didn’t  use  a  GUMP  check. 

•  Twenty  indicated  that  the  appropriate  check¬ 
list  was  not  used  by  the  crew: 

-  At  1,500' in  climb,  an  experienced  Captain 
cut  the  fuel  to  both  engines  (two-engine 
aircraft)  in  response  to  an  annunciator 
light  for  right  engine  EEC.  Copilot  (PF) 
reported  that  the  Capt.  did  not  refer  to  the 
abnormal  checklist  or  coordinate  with 
him  prior  to  the  action. 

-  Crew  looking  forunfamiliar  airport, didn’t 
do  the  final  checklist,  and  landed  gear  up. 
Warning  hom  didn’t  sound  until  the  flare 
-  too  late. 

•  Seventy-four  showed  poor  crew  coordination 

in  the  use  of  a  checklist: 

-  Engine  shut  down  needlessly  in  flight 
during  perfotmance  of  electrical  abnor¬ 
mal  checklist  procedures.  First  Officer 
started  APU  for  backup  -  Captain  saw  the 
low  oil  pressure  light  at  APU  start  and 
mistook  it  for  an  engine  low  oil  pressure 
light,  shutting  down  the  engine.  First  Of- 
ficerdidn’t  inform  Captain  of  starting  the 
APU,  and  Captain  didn’t  confirm  engine 
low  oil  pressure  with  First  Officer  before 
shutting  down  the  engine.  Emergency 
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declared  with  unscheduled  landing. 

-  Aircraft  taxied  across  an  active  runway 
after  instructions  to  hold  short  First  Offi¬ 
cer  got  instructions,  assumed  Captain  had 
heard  them  and  started  doing  the  check¬ 
list,  heads-do  .,il 

-  Early  turn  to  a  SID  (Standard  Instrument 
Departure)  heading  with  traffic  conflict 
Crew  busy  reading  the  checklist  and  not 
backing  each  other  up. 

•  Eighteen  involved  the  use  of  an  incorrect  or 
incomplete  procedure  as  prescribed  by  the 
checklist: 

-  Aircraft  departed  10,0001bs.  light  on  fuel. 
New  fueling  procedure  provided  no  clear 
means  of  fuel  load  verification  for  fuelers 
or  crews. 

-  First  Officer  lost  his  instruments  and  the 
radar  as  he  was  about  to  penetrate  a  line  of 
cells.  Captain  and  Second  Officer  were 
doing  an  electrical  abnormal  checklist 
which  knocked  off  the  instruments  and 
radar. 

•  One-hundred  thirteen  involved  an  interrup¬ 
tion  or  distraction,  either  from  the  use  of  a 
checklist,  from  operational  matters,  or  from 
some  extraneous  event: 

-  Overshot  altitude  by  several  thousand  feet, 
inexperienced  crew  busy  doing  the  check¬ 
list  and  working  ATC  radios. 

-  Altitude  overshot  on  descent  Between 
FL310  and  FL180,  crew  had  five  speed 
changes  and  two  heading  changes.  Subse¬ 
quently  theyhadthreemorespeed  changes, 
two  more  heading  changes,  and  three 
runway  changes  -  the  last  occurring  at 
4001  on  final.  The  altimeter  of  the  pilot 
flying  did  not  get  set  property. 

-  Aircraft  almost  departed  with  a  spoiler 
extended.  Crew  taxiing  with  one  engine 
shutdown.  Controller  advanced  their  take¬ 
off  position.  Rushing  to  complete  every¬ 
thing  and  missed  the  annunciator  light  for 
the  extended  spoiler.  Caught  by  crew  in  a 
following  aircraft 


(The  percentages  add  up  to  more  than  1 00%  because 
many  samples  involved  multiple  considerations.) 

Since  these  reports  are  provided  to  NASA/ASRS  on 
a  voluntary  basis,  information  which  would  not 
otherwise  be  available  is  provided  about  problems 
in  aviation.  Although  they  may  not  be ,  ompletely 
representative  of  the  industry,  these  findings  help  to 
point  out  the  variety  of  the  problems  encountered 
with  regard  to  checklist  misuse. 

SUMMARY  OF  FINDINGS 

•  CHECKLIST  USE 

In  43%  of  the  reports  studied  the  crew  had 
either  not  used  the  checklist  at  all,  or  had 
missed  important  items  on  the  checklist 

•  CHECKLIST  AND  MANUAL  DESIGN 

These  factors  accounted  for  20%  of  the  re¬ 
ports.  Design  problems  included  items  miss¬ 
ing  from  checklists  and  inaccurate  or  incom¬ 
plete  procedures  which  could  lead  to  poten¬ 
tially  dangerous  practices. 

•  TRAINING 

Thirty-eight  percent  of  the  reports  involved 
inadequate  crew  coordinatioa  This  could  in¬ 
dicate  an  absence  of  instructions  in  the  AFM 
or  inadequate  training  in  checklist  use. 

•  INTERRUPTIONS 

Interruptions  accounted  for  58%  of  the  re¬ 
ports.  There  was  about  an  even  division  of  the 
following  two  types  of  disruptions:  » 

-  events,  such  as  ATC  calls,  interrupting  the 
crew’s  use  of  checklists; 

-  the  necessity  to  read  a  checklist  interrupt¬ 
ing  an  operational  task,  such  as  maintain¬ 
ing  a  position  in  a  departure  queue. 

3J  PART  121  AND  PART  135  CHECKLIST 
AND  MANUAL  REVIEW 

We  reviewed  six  Part  121  operators’  and  nine  Part 
135  operators’  manuals  and  checklists  as  one  means 
of  identifying  good  and  bad  aspects  of  current  air 
carrier  checklist  practices.  These  materials  were  not 
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randomly  selected  and  so  are  not  assumed  to  be 
representative  of  what  is  used  in  the  industry.  They 
are,  however,  examples  of  materials  in  daily  use  by 
major  carriers. 

3.3.1  Policy  and  Procedures  for  Checklist  Use 
All  of  the  Part  121  operators  studied  specified  some 
policy  regarding  the  use  of  checklists  for  their  crews 
to  follow.  Some  had  very  specific  guidelines  regard¬ 
ing  who  was  to  read  each  checklist,  by  what  phase  of 
flight  it  was  to  be  accomplished,  in  what  manner  it 
should  be  read  (e.g.,  challenge/response  or  silent), 
whether  with  single  or  dual  response,  and  what 
responses  should  be  given  in  lieu  of  “CHECKED” 
or  “AS  REQUIRED.”  Others  only  used  phrases 
such  as  “Checklist  use  is  mandatory.”,  and  "Safe 
operating  procedures  are  not  overlooked  while  giv¬ 
ing  attention  to  the  checklist.”  Still  others  merely 
specified  who  should  read  each  checklist  and  at 
what  phases  of  flight  they  should  read  it  One 
example  of  this  is  the  airline  specifying  that  the  First 
Officer  should  read  all  “Normal”  checklists  while 
the  aircraft  is  stationary,  and  the  pilot  not  flying 
should  read  all  “Normal”  checklists  while  the  air¬ 
craft  is  in  motion. 

Of  the  Part  135  operators,  only  one  did  not  have 
some  sort  of  policy  for  the  ere  ws  to  follow.  The  other 
policies  ranged  from  numbered  notations  on  each 
checklist  margin  as  to  who  should  answer  each 
challenge,  to  the  very  detailed  and  explicit  direc¬ 
tions  from  one  of  the  carriers  to  their  crews.  Their 
policy  statements  were  as  good  as  some  of  the  larger 
carriers,  and  better  than  others. 

One  carrier  was  unique  among  all  the  carriers  stud¬ 
ied  in  that  it  specified  that  its  “Normal”  checklists 
were  to  be  used  as  “work”  lists  rather  than  “done” 
lists.  Rad  er  than  the  items  being  accomplished  and 
then  checked  for  completion  by  the  use  of  the 
checklist,  it  specified  that  the  challenge  be  read,  the 
item  be  accomplished,  and  then  the  response  be 
given,  indicating  accomplishment.  While  this  is 
sometimes  the  case  with  “Emergency”  checklists, 
and  often  the  case  with  “Abnormal”  checklists,  it  is 
not  usual  with  “Normal”  checklists. 

Three  issues  arise  with  policy  and  procedures  for 
checklist  use.  They  are: 

•  When  should  checklists  be  used? 

The  time  a  checklist  is  to  be  used  is  spelled  out, 

in  part,  in  the  name  of  the  checklist;  e.g., 


"BEFORE  TAXI,”  “BEFORE  LANDING,” 
etc.  Some  of  the  carriers  in  their  policy  state¬ 
ments  are  even  more  specific;  prescribing  in 
what  phase  of  flight,  and  at  what  point  in  die 
phase  of  flight  a  checklist  is  to  be  read.  In  a 
number  of  the  cases  we  studied,  however,  this 
was  left  to  the  pilot 

•  Who  should  read/respond  to  the  checklist 
items? 

This  was  handled  by  the  airlines  in  a  multitude 
of  ways.  Some  addressed  the  issue  with  a 
detailed  policy  statement  stating  which  plot 
should  read  which  checklist  and  which  pilot 
should  respond.  Others  made  a  margin  nota¬ 
tion  on  each  checklist  with  anumber  designat¬ 
ing  which  pilot  was  to  respond.  Others  did  not 
address  the  issue. 

Another  point  in  this  issue  is  that  of  dual 
response.  This  involves  items  which  must  be 
checked  and  responded  to  by  at  least  two 
crewmembers,  frequently  at  busy  phases  of 
flight;  some  airlines  have  items  to  which  all 
members  of  a  three-person  crew  must  re¬ 
spond.  This  creates  a  division  of  attention  for 
the  pilot  flying.  Of  the  Part  121  carriers  stud¬ 
ied,  most  used  some  dual  response  items  in  all 
“Normal”  checklists,  whereas,  of  the  Part  135 
carriers,  only  one  did.  One  of  the  Part  121 
carriers  limiteddual  response  items  to  “GEAR” 
and  “FLAPS,”  and  then  only  on  two  checklist 
procedures;  “FLAPS”  on  the  ‘TAXI”  proce¬ 
dures  list,  and  “GEAR”  and  “FLAPS”  on  the 
“LANDING”  procedures  lisL  Limiting  dual 
response  requirements  to  one  or  two  items 
reduces  the  amount  of  time  when  both 
crewmembers  have  their  heads  down,  yet  pro¬ 
vides  an  additional  level  of  attention  to  ensure 
that  the  gear  and  flaps  are  positioned  properly 
for  high-risk  phases  of  flight 

*  How  should  the  checklists  be  used? 

This  issue  was  not  addressed  by  many  of  the 
airlines.  And  those  that  did  address  it  were  not 
always  consistent  As  an  example,  let  us  use 
thechecklistresponse“AS  REQUIRED.”  One 
carrier  did  not  use  any  “AS  REQUIRED” 
responses  on  some  of  its  aircraft,  but  did  on 
others. 
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Hie  general  issue  of  requiring  a  specific  re¬ 
sponse  in  lieu  of  the  “AS  REQUIRED”  shown 
on  a  checklist  was  addressed.  The  request  for 
a  specific  response  requires  that  the  crew  look 
at  the  item  being  checked  in  order  to  give  that 
response.  The  discretion  to  answer  “AS  RE¬ 
QUIRED”  permits  careless  checking  and  poor 
checklist  habits.  Six  of  the  Part  13S  carriers 
allowed  the  use  of  the  “AS  REQUIRED” 
response,  as  did  two  of  the  Part  121  carriers. 
The  handbooksofthreeof  the  Part  121  carriers 
stated  that  a  specific  answer  should  be  substi¬ 
tuted  for“  AS  REQUIRED,"  and  one  Part  135 
carrier  very  specifically  disallowed  “AS  RE¬ 
QUIRED”  and  specified  precise  responses. 
Examples  of  this  would  be  “12  QUARTS,” 
“ON,”  etc.  One  major  carrier  eliminated  the 
problem  by  not  having  “AS  REQUIRED”  as 
a  checklist  response. 

3.3.2  Alphanumerfcs 

The  comparison  of  print  size  and  letter  case  used  in 
the  text  of  the  checklists  revealed  a  number  of 
problems.  This  was  true  of  both  the  Part  121  carriers 
and  the  Part  135  carriers. 

“Normal"  checklists  for  all  but  one  of  the  Part  121 
carriers  and  50%  of  the  Part  135s  were  in  10-point 
type,  and  usually  in  all  caps  (see  Ftgure  3-1).  This 
was  normally  quite  legible,  but  in  some  cases,  the 
quality  of  print  was  poor  and  that  affected  the 
legibility  considerably.  MIL  SPECS  (MIL-C- 
81222C  and  MDL:-C-38778A)  recommend  the  use 
of  12-point  type  for  the  body  of  the  text.  One  of  the 
Part  121  carriers  used  six-point  type,  mixed  case 
(see  Figure  3-1),  their  checklists  were  difficult  to 
read,  and  it  would  have  been  easy  to  lose  one ’s  place 
if  distracted  by  other  operational  requirements.  In 
the  Part  135  checklists,  of  the  50%  that  did  not  use 
10-point  type,  the  type  size  varied  down  to  seven- 
point,  mixed  case,  and  was  not  very  legible.  One  set 
of  regional  checklists  incorporated  a  V  speed  table 
in  five-point  type  (see  Figure  3-1),  and  the  numbers 
were  almost  illegible. 

“Abnormal”  and  “Emergency”  checklists  showed 
even  greater  inconsistency  in  alphanumeric  sizes 
than  the  “Normal"  checklists.  One  major  carrier  in 
their  “Normal"  checklist  used  10-point  type,  all 
caps.  Yet  their  “Abnormal”  checklist,  although  ;;ept 
in  a  well-tabbed  pilots’  handbook  and  easy  to  find, 
was  in  six-point  type  and  mixed  case,  and  difficult 
to  read.  Their  “Emergency”  checklists  were  pre¬ 
sented  on  a  color-coded  paper  card  with  one  side  in 


10-point  type,  the  other  side  in  eight-point  type. 
Both  sides  were  in  all  caps.  The  eight-point  was 
slightly  less  legible  than  the  10.  It  appears  that  this 
combination  of  type  was  used  in  order  to  include  ail 
the  checklist  items  on  a  single  card.  Another  Part 
121  carrier,  although  using  legible  10-point  type  in 
their  “Normal”  checklist,  used  eight-point  type  and 
all  capitals  with  the  letters  spaced  closely  together 
for  their  other  checklists. 

Among  the  Part  135  checklists,  the  same  sorts  of 
problems,  but  more  pronounced,  were  often  seen. 
One  of  the  regionals  used  legible  10  poi.it  type  for 
the  “Normals"  and  then  reduced  to  seven-point  type 
for  their  “Emergency”  checklists.  The  reverse  was 
found  in  another  case,  with  the  “Normal”  checklists 
in  the  small,  difficult-to-read  print. 

The  practice  of  using  smaller,  less  legible  type  for 
“Abnormal”  and  “Emergency”  checklists  than  for 
“Normal”  checklists  was  found  amongst  both  major 
and  regional  carriers.  Since  these  are  checklists 
which  are  used  under  conditions  of  stress,  and  often 
with  poor  illumination,  they  should  be  as  legible  as 
possible,  and  surely  not  smaller  than  the  “Normal” 
checklists. 

Clear,  10-point  type  presents  a  legible  checklist,  and 
is  used  by  anumberofthemajor  carriers  we  studied. 
However,  with  type  larger  than  10-point,  as  is  rec¬ 
ommended  by  the  aforementioned  MIL  SPECS  and 
by  the  Human  Engineering  Guide  to  Equipment 
Design,  the  checklist  page  becomes  larger,  or 
morepages  are  necessary,  and  checklist  stowage  and 
handling  becomes  more  of  a  problem. 

3.3.3  Method  of  Presentation 
All  of  the  Part  121  carriers  studied  used  paper 
checklists  for  at  least  the  bulk  of  their  “Normal” 
checklists.  By  contrast,  only  50%  (five)  of  the  Part 
135  operators  did  this.  One  Part  135  carrier  had  its 
“Normal”  checklists  on  a  laminated  card,  and  the 
other  four  were  in  either  a  manual  or  a  separate 
checklist  booklet. 

One  of  the  major  carriers  studied  used  paper  check¬ 
list  cards  for  all  but  the  “BEFORE  TAKEOFF”  and 
“BEFORE  LANDING”  checklists.  These  were 
mechanical,  in  either  a  lighted  slide  or  a  lighted 
toggle  switch  configuration,  depending  on  the  air¬ 
plane  type.  They  did  have  a  printed  backup  in  the 
Operating  Manual  to  cover  the  possibility  of  a 
mechanical  checklist  malfunction.  The  use  of  these 
mechanical  checklists  for  this  limited  use  was  re- 


FIGURE  3-1.  TYPEFACE  SAMPLES 


BEFORE  STARTING  ENGINES 
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02  PANELS/MASKS/INTERPHONE/ 

GOGGLES . SET  AND  CHECKED 

EMERGENCY  LIGHTS . ARMED 

PROBE  HEAT . CAPT 

WINDSHIELD  ANTI-ICE . ON 

ANTI-SKID . OFF 

PRESSURIZATION . AUTO  (UP)  AND  SET 

AIR  CGND  SHUTOFF . AUTO 
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FLAPS/SLATS . UP/RETRACTED 
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ported  on  very  favorably  by  the  pilots  using  them 
during  our  cockpit  observation  on  that  airline. 

One  Part  121  airline  used  paper  checklist  cards  for 
“Normal,”  “Abnormal,”  arid  “Emergency”  check¬ 
lists,  and  stowed  them  all  in  the  cockpit.  The  size  of 
the  paper  checklist  cards  studied  varied,  and  is 
important  only  in  that  it  must  be  large  enough  to  hold 
legible  checklists,  and  small  enough  to  be  stowed 
readily  in  some  location  in  the  cockpit. 

Those  studied  ranged  from  a  fourfold  10  7/8"  x  5  1/ 
2"  to  a  no-fold  8  1/2"  x  1 1.”  The  former  was  very 
crowded  and  difficult  to  read,  whereas  the  latter  was 
very  legible.  In  some  cases,  the  large  cards  designed 
to  be  no-fold  were  observed  to  have  been  folded  by 
the  crews,  presumably  for  convenience. 

Most  of  the  carriers  kept  their  “Abnormal"  and 
“Emergency”  checklists  in  manuals  or  booklets  of 
some  sort.  All  of  the  Part  135  manuals  studied,  and 
some  of  the  Part  121  manuals,  lacked  tabbing  for 
quick  reference  and  easy  identification.  This  lack  of 
tabbing  could  provide  an  added  impediment  to  a 
crew  at  a  time  when  they  are  already  dealing  with  a 
situation  other  than  normal.  The  use  of  a  booklet, 
capable  of  being  stowed  in  the  cockpit,  is  preferable 
to  a  manual  stowed  in  a  flight  bag  from  the  stand¬ 
point  of  accessibility.  Handier  yet  would  be  a  sepa¬ 
rate  card  of  “Emergency”  checklists  stowed  in  the 
cockpit. 

If  a  booklet  or  a  manual  is  to  be  used,  it  should  be 
properly  tabbed  for  quick  reference.  Each  major 
section  should  be  tabbed  with  the  name  of  the 
section,  and  each  subject  within  a  section  tabbed  to 
correspond  with  the  appropriate  subject  shown  in 
the  section  index.  The  section  index  should  be  on  the 
first  page  of  each  section,  following  the  tab.  If  the 
manual  contains  a  section  on  aircraft  systems,  there 
should  be  a  tabbed  subsection  for  each  individual 
system,  (e.g.,  engines,  flight  controls,  etc). 

3.3.4  Color  Coding 

Two  of  the  Part  121  carriers,  and  three  of  the  Part 
135  carriers  used  color  coding  for  easy  identifica¬ 
tion  of  “Abnormal”  and  “Emergency”  checklists. 
There  have  been  instances  cited  in  ASRS  reports  in 
which  crews  have  had  difficulty  in  locating  “Emer¬ 
gency"  checklists.  Human  factors  research  indi¬ 
cates  that  color  coding  can  be  effective  in  helping  to 
identify  emergency  checklists.  Advisory  Circular 
25-11,  dated  7/16/87  recommends  red  be  used  for 
the  most  serious  conditions,  and  yellow  be  used  for 


abnormal  conditions  of  a  less  immediate  nature. 

3.3.5  Memory  Items 

Memory  items  on  "Emergency”  checklists  have 
been  a  point  of  difference  in  corporate  philosophies 
for  years.  Of  the  Part  121  “Emergency”  checklists 
reviewed,  all  had  some  form  of  memory  items;  those 
items  which  the  crew  must  commit  to  memory  for 
performance  in  an  emergency  situation,  to  bring  the 
emergency  under  control  before  referring  to  the 
checklist.  One  major  carrier,  which  was  not  in¬ 
cluded  in  our  study ,  has  adopted  the  philosophy  that 
memory  items  are  not  only  not  necessary,  but  may 
precipitate  a  mistake  through  too  much  haste.  They 
have  eliminated  memory  items  from  their  “Emer¬ 
gency”  checklists,  and  instead  use  them  as  lists  from 
which  to  work.  This  is  not  the  case  with  most 
carriers.  They  range  from  having  memory  items  for 
all  the  initial  steps  in  all  the  “Emergency"  checklists 
to  a  very  limited  number  of  items  on  a  small  number 
of  checklists.  The  former  is  more  common.  The 
latter  is  represented  by  one  c r  the  Part  121  operators 
in  our  sample.  Only  three  of  their  “Emergency” 
checklists  contained  memory  items:  “ENGINE 
FAILURE,”  “ENGINE  FIRE,”  and  “ENGINE 
TAILPIPE  FIRE,”  and  each  list  contained  only  one 
memory  item.  In  all  three  cases  the  item  was  the 
same,  “THROTTLE.CLOSE . CLOSE.” 

The  Part  135  carriers  were  apparently  not  much 
different  from  the  Part  121  carriers  in  this  regard.  Of 
the  10  studied,  eight  used  memory  items.  One  did 
not  require  them,  and  the  tenth  provided  no  “Emer¬ 
gency"  checklists  for  study. 

3.3.6  Manual  and  Checklist  Contents  and  Orga¬ 
nization 

The  Part  121  carriers  generally  exhibit  more  legible 
and  professional-looking  checklists  and  manuals 
than  their  Part  135  counterparts.  However,  there  is 
still  room  for  standardization  and  improvement. 
Despite  the  generally  high  quality  of  professional 
standards  and  performance  of  Part  121  scheduled 
carrier  pilot  groups,  there  have  been  many  instances 
of  lapses  in  checklist  use,  some  with  catastrophic 
results.  If  minimum  standards  for  legibility,  acces¬ 
sibility,  and  quick  recognition  were  adopted,  the 
availability  of  a  checklist  easy  to  read  and  use  would 
discourage  checklist  misuse,  whereas  lack  of  stan¬ 
dards  in  the  p^st  has  contributed  to  this  misuse. 
From  that  point  it  would  become  a  question  of 
airline  training  and  discipline,  and  individual  pro¬ 
fessionalism. 
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The  material  from  the  regional  Part  121  carrier 
studied  illustrated  some  of  the  shortcomings  found 
in  the  manuals  and  checklists  of  smaller  carriers, 
especially  the  Part  135  carriers,  many  of  which  fly 
airplanes  produced  outside  the  United  States.  Al¬ 
though  the  manuals  and  checklists  of  U.S.  aircraft 
manufactured  for  the  regional  and  Part  135  market 
don’t  generally  come  up  to  the  standards  of  those 
produced  by  the  U.S.  manufacturers  of  large  air¬ 
craft,  the  problems  seem  to  be  even  worse  in  manu¬ 
als  and  checklists  for  aircraft  of  foreign  manufac¬ 
ture.  Part  of  this  is  a  problem  of  language  and 
terminology.  Part  of  it  seems  to  arise  from  the  fact 
that  the  manual  and  checklist  material  from  foreign 
manufacturers  is  approved  by  their  equivalent  of  the 
FAA  under  the  bilateral  agreement.  Problems  in¬ 
clude: 

«  Lack  of  tabs  in  the  manuals,  which  makes  it 
more  difficult  to  find  important  information 
quickly.  One  manual  was  tabbed  but  most  of 
the  tabbed  sections  were  not  numbered,  even 
though  references  were  made  to  those  sections 
by  number. 

•  Accessibility  of  important  information.  One 
AFM  had  no  systems  descriptions  of  any  sort 
Another,  in  its  “Abnormal”  and  “Emergency” 
sections,  frequently  made  references  to  fig¬ 
ures  and  paragraphs  in  otherparts  of  the  manual 
rather  than  supplying  the  needed  information 
at  that  point.  These  characteristics  decrease 
the  value  of  the  manual  as  a  reference  in 
addressing  abnormal  and  emergency  situa¬ 
tions. 

•  An  excessive  number  of  “Emergency”  check¬ 
lists,  and  a  classification  of  “EMERGENCY” 
which  was  not  consistent  with  general  usage  in 
the  United  States.  The  AFM  for  one  foreign 
airplane  contained  82  “Abnormal”  and  “Emer- 
gency”checklists,  of  which  39  were  classified 
“Emergency.”  Many  of  the  39  would  not  have 
been  classified  “Emergency”  by  most  U.S. 
standards. 

•  An  excessive  numberofmemory  items.  These 
checklists  were  for  an  airplane  operated  by  a 
regional  carrier,  sometimes  flown  by  low- 
experience-level  crews.  This  combination  of 
an  overwhelming  number  of  memory  items 
and  low-lime  crews  is  conducive  to  errors  in 
emergencies. 


•  Missing  items  on  checklists.  Examples  of  this 
are  seen  in  the  following. 

-  Carrier  B 

No  mention  of  “GEAR”  on  the  “BE¬ 
FORE  STARTING”  checklist,  and  no 
mention  of  “FLAPS"  on  any  checklist 
prior  to  takeoff. 

-  Carrier  E 

On  all  three  groups  of  checklists — “Nor¬ 
mal,"  “Abnomtal,”  and  “Emergency” — 
there  appear  challenges  without  responses, 
as  in  “EXCESSIVE  LOADMETER 

FAILURE,"  “BATTERY . "  (no 

response). 

-  Carrier  G 

Operationally  important  items  not  carried 
over  to  the  checklists  from  the  AFM  in¬ 
cluded: 

•  From  “ENGINE  FIRE  OR  SEVERE 

DAMAGE,”  “FUEL  CROSS¬ 
FEED . SHUT.” 

•  From  “ELECTRICAL  SMOKE  OR 

FDRE,”“RECIRCFaN . OFF.” 

•  In  some  cases,  “Emergency”  checklists  were 
not  carried  over  from  the  AFM  to  the  operating 
checklists.  FAR  125.71  stales  that  “Each  cer- 
ti  ficate  holder  shall  prepare  and  keep  current  a 
manual.  A  copy  of  the  manual...  shall  be 
...furnished  to  -  (1)  Its  flight  crewmembers.” 
FAR  125.73  says  “The  manual  must 
include...(m)procedures  for  ensuring  compli¬ 
ance  with  emergency  proced_  cs,...”  FAR 
25.1581  states  “An  Airplane  Flight  Manual 
must  be  furnished  with  each  airplane,  and  it 
must  contain  the  following:  ...(1)  Information 
required  by  25.1583  through  25.1587.” 
25.1585,"Operating  Procedures,"  includes 
emergency  operation  of  the  systems.  One  car¬ 
rier  was  using  checklists  that  did  not  include 
1 1  “Emergency”  checklists  that  were  in  the 
AFM.  This  certainly  circumvents  the  intent  of 
the  FARs.  Among  the  checklist  procedures 
that  were  missing  were  the  following: 
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-  “ENGINE  OVERSPEED" 

-  “PROP  OVERSPEED” 

-  “FUSELAGE  SMOKE  OR  FIRE” 

-  “DOUBLE  GENERATOR  FAILURE” 

-  “BATTERY  OVERHEAT’ 

The  “Emergency”  checklists  of  another  car¬ 
rier  also  lacked  many  operationally  significant 
procedures  which  were  in  the  AFM.  Among 
these  were: 

-  “PROP  MALFUNCTION  —  OVER¬ 
SPEED” 

-  “FUSELAGE  FIRE” 

-  “TOTAL  ELECTRICAL  FAILURE” 

-  “LOSS  OF  ALL  SYSTEM  FLUID” 

Manufacturers  as  well  as  operators  were  re¬ 
miss.  An  example  can  be  shown  from  the 
AFM  of  one  Part  135  aircraft  It  lacks  proce¬ 
dures  or  checklists  to  deal  with  problems  such 
as  “LOSS  OF  ALL  GENERATORS.” 

•  Procedures  were  not  presented  in  the  order  in 
which  they  should  be  accomplished.  One  Part 
135  canier’s“Nonnal”checklisthafl  “SHUT¬ 
DOWN”  Mowing  “BEFORE  TAKEOFF.” 
Normally  “SHUTDOWN”  is  the  last  of  the 
“Normal”  procedures.  Procedures  should  be 
presented  in  chronological  order. 

•  Intemd  inconsistencies  were  also  found.  These 
concerned  a  variety  of  issues  such  as: 

-  Crew  size.  One  operator’s  “Emergency” 
section  preface  contained  the  following 
statement: 

“Emergency  procedures  have  been  for¬ 
mulated  based  on  single-pilot  operation 
of  the  airplane.” 

However,  throughout  the  section  of  the 
Company  Aircraft  Operating  Manual  de¬ 
voted  to  Flight  Operations,  there  are  many 
references  to  “Pilots"  (plural)  and  “Crew 
Coordination.”  Although  the  aircraft  can 
be  flown  single-pilot,  it  was  obvious  that 
the  company  intends  it  to  be  flown  as  a 
two-  pilot  operation  at  least  part  of  the 
time.  Yet,  nowhere  was  it  addressed  how 
emergencies  were  to  be  handled  during 
two-pilot  operation. 


-  Aircraft  equipment  Another  example  of 
confijsion  in  a  Part  135  carrier  AFM 
conoemed  the  response  to  a  warning 
light  The  instructions  were  as  follows: 
“Any  illumination  (or  flicker)  of  either 
CHIP  DETECT  annunciator  light  (if 
installed)  requires  immediate  shutdown 
of  the  affected  engine.” 

It  is  strange  that  an  annunciator  light  so 
important  that  its  illumination  requires 
immediate  shutdown  of  an  engine  could 
be  placed  on  the  list  of  options  for  an 
aircraft,  and  not  be  required  equipment 

-  Procedures.  Another  carrier  exhibited 
confusion  between  the  AFM  and  the  op¬ 
erational  checklist  In  the  “AIR  START 
—  NO  STARTER  ASSIST’  checklist 
one  item  in  the  AFM  called  for  “PROP 

LEVER . FULL  FORWARD." 

The  same  item  in  the  checklist  from  the 
CAOM  said  “PROP  LEVER... 

. FEATHERED.”  Since  the  two  are 

opposite  actions,  we  wonder  which  is 
correct 

If  flight  crews  are  to  be  expected  to  have 
confidence  in  and  use  checklists,  the  pro¬ 
cedures  that  the  lists  describe  must  be 
correct  and  must  be  consistent  with  the 
procedures  described  in  the  associated 
manuals. 

•  A  lack  of  clarity  of  purpose  of  the  checklist  and 
the  AFM.  An  AFM  is  designed  to  present 
specific  information  to  an  operator’s  person¬ 
nel,  including  flight  crews,  about  the  opera¬ 
tions  of  the  aircraft  It  is  not  nor  is  it  intended 
to  be,  a  training  manual.  This  is  also  the  case 
with  a  checklist  which  is  to  be  used  to  assure 
proper  completion  of  items  necessary  for  safe 
operation  of  the  aircraft  Despite  this,  some 
operators  use  AFMs  and  checklists  for  con¬ 
veying  messages  which  should  be  given  in 
training.  Examples  of  this  are  illustrated  from 
these  instances  in  one  carrier’s  checklists  and 
another’s  AFM. 

-  ‘ ‘Immediately  prior  to  touchdown,  lower 
up- wind  wihg  and  align  the  fuselage  with 
the  runway  by  use  of  the  rudder.” 

-  “Piloting  with  an  engine  inop.”  -  "Use 
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rudder  and  control  wheel  to  control  air¬ 
craft  heading,  maintaining  aircraft  wings 
essentially  leveled.” 

-  The  “SYNPHR  (synchrophaser)  FAIL" 
checklist  gives  a  procedure  for  eliminat¬ 
ing  the  beat  between  the  engines  if  the 
synchrophaser  is  inoperative. 

Pilots  at  the  earner  stage  of  flying  for  an  airline 
should  not  need  basic  flying  lessons.  If  they 
are  not  aware  of  the  proper  techniques  by  this 
time,  training  would  seem  a  more  appropriate 
means  for  correcting  this  than  a  checklist 
Including  training  information  in  AFMs  and 
checklists  only  increases  their  size  and  detail, 
and  makes  than  more  difficult  to  use  for  their 
intended  purpose. 

The  format  and  content  of  a  number  of  the  regional 
carrier  AFMs,  Company  Operating  Manuals,  and 
checklists  that  we  reviewed  indicated  a  need  for 
standards  and  careful  oversite  concerning  their  de¬ 
sign  and  publication.  While  some  carriers  provide 
their  crews  with  manuals  and  checklists  that  are 
accurate  and  easy  to  use,  others  do  not  appear  to 
recognize  the  importance  of  these  documents  to 
flight  safety.  One  of  the  worst  examples  was  seen  in 
the  “Emergency”  checklist  of  one  Part  1 35  Carrier. 
These  had  been  stamped  “FAA  APPROVAL”  and 
signed  off  by  a  POI  (even  though  not  required  for  a 
Part  135  operation)  but  lacked  procedures  for  11 
“Emergencies”  that  were  in  the  AFM.  There  were 
several  carriers  using  checklists  that  were  missing 
procedures  that  were  specified  in  their  AFMs;  a 
number  of  these  involving  operationally  significant 
items.  Some  of  these  omissions  are  in  violation  of 
FAR  135.83  (c).  This  may  be  symptomatic  of  the 
regional  Part  121  and  the  Part  135  operators,  and  the 
surveillance  given  them.  The  interpretation  of  the 
FARs  by  POls  is  sometimes  inconsistent,  and  vari¬ 
able  enforcement  may  result  from  this.  This  leads  to 
practices  in  the  use  and  design  of  manuals  and  to 
checklists  which  are  questionable,  and  which  at 
times  detract  from  the  safety  standards  intended  to 
be  provided  by  these  documents. 

3.3.7  Summary  of  Findings 

•  POLICY  AND  PROCEDURES  FOR 
CHECKLIST  USE 

All  of  the  carriers  had  some  direction  for  the 
use  of  checklists  by  their  crews.  The  policies 


varied  widely  from  carrier  to  carrier,  though 
not  necessarily  differing  according  to  the 
carrier's  size.  Some  were  very  detailed  poli¬ 
cies,  spelled  out  in  operating  manuals,  cover¬ 
ing  all  aspects  of  checklist  use,  and  some  were 
only  notations  in  the  margin  of  a  checklist 
noting  who  was  to  respond  to  a  challenged 
item. 

Several  NTSB  and  ASRS  reports  identified 
poorcrew  coordination  in  the  use  of  checklists 
as  a  likely  contributor  to  aircraft  accidents. 
The  absence  of  detailed  policies  and  proce¬ 
dures  concerns  the  responsibilities  of  indi¬ 
vidual  crewmembers  in  the  use  of  checklists 
increases  the  possibility  of  poor  crew  coordi¬ 
nation  during  safety-critical  activities  involv¬ 
ing  checklist  use. 

Dual  responses  to  checklist  items  were  used 
by  mosi  Part  121  carriers,  but  by  only  one  Part 
135  operator.  Many  pilots  consider  multiple 
responses  to  checklist  items  to  reduce  safety. 
Checklists  are  frequently  done  on  the  roll. 
When  the  heads  of  both  pilots  go  down,  even 
for  a  moment,  safety  is  compromised. 

The  response  "AS  REQUIRED”  was  allowed 
by  two  of  the  six  Part  1 2 1  carriers  and  six  of  the 
nine  Part  135  carriers.  Many  required  a  spe¬ 
cific  response  of  a  quantity  or  setting  in  place 
of  “AS  REQUIRED.” 

•  ALPHANUMERIC^ 

The  bodies  of  the  checklists  varied  from  clear, 
legible  10-point  type,  all  caps,  with  good  print 
quality,  to  six-point  type,  mixed  case,  difficult 
to  read.  In  some  cases,  the  type  size  used  on 
“Emergency"  lists  was  smaller  than  that  used 
on  the  “Normals."  Closely  packed  six-point 
type  is  difficult  to  read  quickly  under  any 
conditions.  It  is  easily  misread  under  the  stress 
of  emergencies  and/or  under  low  cockpit  illu¬ 
mination.  The  size  and  resources  of  the  carrier 
had  no  apparent  bearing  on  the  legibility  of  the 
checklist:  a  major  carrier  had  one  of  the  most 
illegible  checklists  examined. 

•  CHECKLIST  PRESENTATION 

Paper  checklists  were  most  commonly  used 
for  "Normal"  checklists,  although  one  carrier 
used  laminated  cards.  Another  carrier  used  a 
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mechanical  checklist  for  “BEFORE  TAKE¬ 
OFF’  and  “BEFORE  LANDING,”  although 
they  used  paper  checklists  for  all  other  “Nor¬ 
mal”  checklists. 

With  one  exception,  “Abnormal”  and  “Emer¬ 
gency”  checklists  were  kept  in  manuals,  many 
of  which  were  not  tabbed  for  quick  reference. 
The  earner  that  was  the  exception  used  paper 
cards  in  color-coded  folders  kept  in  the  cock¬ 
pit. 

\ 

•  COIvOR  CODING 

Only  fiveofthe  carriers  used  any  color  coding, 
despite  the  fact  that  it  could  facilitate  location 
of  a  critical  checklist  Carriers  cite  cost  as  their 
reason  for  not  using  color  coding. 

•  MEMORY  ITEMS 

Most  carriers  studied  used  memory  items  in 
“Emergency”  checklists.  One  Part  121  carrier 
had  reduced  them  to  one  item  on  each  of  three 
checklists,  and  one  Part  135  operator  had  no 
memory  items. 

«  CONTENTS  AND  ORGANIZATION  OF 
MANUALS  AND  CHECKLISTS 

Manuals  and  checklists  for  aircraft  produced 
outside  the  United  States  often  have  problems 
with  language,  they  lack  tabs,  there  is  insuffi¬ 
cient  detail,  they  contain  too  many  modifica¬ 
tions  and  changes,  and  have  a  classification  of 
checklists  different  from  what  is  normally 
found  in  the  United  States.  In  addition,  opera¬ 
tors  repoit  that  changes  are  very  difficult  to  get 
approved  by  the  Administrator. 

There  were  a  number  of  instances  of  missing 
items  on  checklists,  and  groups  of  checklists 
not  carried  from  the  AFMs  to  the  operating 
checklists. 

Also,  a  number  of  things  which  could  create 
confusion  for  the  crews  using  them  were  noted. 
In  some  cases  the  order  in  which  checklists 
were  listed  differed  from  the  sequence  in 
which  the  actions  should  be  taken,  thereby 
making  them  more  difficult  to  use.  Inconsis¬ 
tent  policy  statements  on  the  handling  of  emer¬ 
gencies  were  seea  And  there  was  one  instance 
of  opposing  actions  being  prescribed  by  the 


AFM  and  the  operating  checklist  on  one  “Ab¬ 
normal”  checklist  item. 

The  manuals  and  checklists  of  the  Pan  121 
carriers  are  generally  better  than  those  of  the 
Part  135  carriers,  but  they  could  still  be  im¬ 
proved  and  standardized.  There  are,  however, 
major  Part  121  carriers  that  are  worse  in  this 
respect  than  some  Pan  1 35  carriers,  so  it  is  not 
possible  to  judge  quality  only  by  the  size  and 
prominence  of  the  carrier.  AFMs  for  aircraft 
flown  by  regional  carriers,  v  hether  produced 
by  foreign  manufacturers  or  in  the  U.S.,  were 
often  not  of  the  quality  of  content  of  those 
produced  by  the  large  U.S.  manufacturers. 

Frequently,  there  were  large  discrepancies 
between  the  content  of  the  AFM  and  what  was 
included  in  the  Company  Operating  Manuals 
and  checklists.  Yet,  there  were  instances  where 
the  abbreviated  checklists,  although  lacking 
parts,  were  stamped  “FA  A  APPROVAL”  and 
signed  off  by  a  POI.  This  would  seem  to 
demand  more  cautious  and  knowledgeable 
surveillance. 

3.4  ALPA  SURVEY 

3.4.1  Introduction 

A  survey  of  airline  pilots  was  done  by  the  Air  Line 
Pilots  Association  (ALPA)  to  obtain  opinions  on  the 
design  and  use  of  checklists  from  those  who  use 
them  on  a  daily  basis.  Surveys  were  mailed  by 
ALPA  to  the  Central  Air  Safety  Chairmen  and  Loci 
Air  Safety  Chairmen  of  eight  airlines,  for  distribu¬ 
tion  to  “pilots  in  different  crew  positions  and  flying 
different  aircraft,  if  possible/  Survey  questions 
ranged  from  the  subject  of  pilots*  use  of  checklists 
to  the  design  of  checklists.  ALPA  promised  ano¬ 
nymity  and  requested  a  return  within  a  one-month 
period.  Eighty  survey  forms  were  sent  out  and 
returned.  (A  copy  of  the  survey,  including  important 
results,  is  attached  as  Appendix  D.) 

3.4.2  Respondent  Characteristics 

•  The  numberof  types  of  transport  aircraft  flown 
ranged  from  1  to  over  10  per  individual,  with 
an  average  of  3.83  types. 
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•  The  average  hours  in  each  seat  were: 


Captain  4,140 

First  Officer  5,570 

Second  Officer  2,910 

(22  had  no  S/O  time) 

*  The  lowest  hours  in  each  seat  were: 

Captain  0 

First  Officer  3,000 

Second  Officer  2,000 

*  The  highest  hours  in  each  seat  were: 

Captain  20,000 

Fust  Officer  10,000 

Second  Officer  5,000 


•  Age  ranged  from  31  to  66  (the  oldest  being  a 
retread  Captain  returning  as  Second  Officer) 
with  an  average  age  of 45.78  years. 

•  Forty-one  percent  wore  corrective  lenses  to 
fly. 


3,4  J  Checklist  Layout,  Design,  and  Use 

•  POLICY  FOR  CHECKLIST  USE 

Ninety-three  point  six  percent  responded  that 
their  airlines  spelled  out  a  standardized  method 
for  the  use  of  checklists.  (This  is  considerably 
more  than  we  found  in  our  review  of  Parts  121 
and  1 35  carriers.)  Almost  as  many  felt  that  the 
crews  followed  the  prescribed  method.  How¬ 
ever,  when  asked  if  the  prescribed  method 
could  be  improved  upon,  almost  half  said 
“Yes."  Some  of  the  pertinent  suggestions 
included  simplification,  enforcement,  and  stan¬ 
dardization. 

-  “Simplified  (checklists)  to  prevent 'crews 
not  using  prescribed  method’,  and  use 
enforced  by  all  levels  of  administration 
and  training." 


-  “Responses  from  aircraft  (type)  to  aircraft 
(type)  should  be  the  same.” 

(One  problem  with  this  is  that  the  manu¬ 
facturers  can’t  agree  on  what  the  name  for 


an  object  is — i.e.,“powerlcver”/"throttle,” 
etc.,  and  many  checklist  responses  are  tied 
to  placards  on  cockpit  panels  or  aircraft 
manual  terminology.) 

-  “Do  not  require  dual  response  by  the  pilot 
flying  the  aircraft’’ 

•  “On  two-man  crews,  checklists  are  too 
long,  especially  final  items  before  take¬ 
off.  And  I  feel  the  F/O  (First  Officer) 
should  read  the  challenge  and  respond 
while  on  the  ground."  (The  respondent 
wants  the  F/O  to  be  responsible  for  all 
aspects  of  the  checklists  on  the  ground, 
freeing  the  Captain  for  operational  du¬ 
ties.) 

•  ALPHANUMERICS 

Thirty-nine  percent  felt  it  was  easy,  with  cur¬ 
rent  checklist  typography  and  designs,  to  skip 
items  unintentionally.  Although  94.5%  indi¬ 
cated  that  print  size  was  adequate,  when  asked 
later  in  the  survey  if  they  felt  that  larger  print 
would  be  an  improvement,  75%  said  “Yes." 
The  fact  that  41%  of  those  responding  wear 
corrective  lenses  to  fly  may  be  pertinent  here. 

•  METHOD  OF  PRESENTATION 

-  LAMINATED  CARDS 

Of  those  responding,  66%  are  currently 
using  laminated  cards,  either  for  their 
"Normal”  checklists  or  for  all  checklists. 
Of  these,  20%  use  another  form  of  check¬ 
list  in  addition  (such  as  “Emergency”  and 
“Abnormal”  checklists  kept  in  a  manual). 
Eighty-eight  felt  that  it  was  not  advanta¬ 
geous  to  use  a  mix  or  combination  of 
checklist  types,  such  as  paper  and  me¬ 
chanical  checklists. 

-  ELECTRONIC  CHECKLISTS 

The  small  number  (six)  of  respondents 
using  electronic  checklists  on  CRTs  felt 
the  CRT  was  superior  to  the  papercheck- 
listexcept  on  “heads-down  time"  required. 
On  that,  three  felt  the  CRT  took  more 
“heads-down  time,”  two  felt  the  paper 
checklist  did,  one  declined  to  answer  the 
question.  They  all  felt  that  the  CRT  check- 
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lists  were  easier  to  use  in  all  cockpit 
lighting  conditions;  that  they  were  easier 
to  get  at;  that  they  were  easier  to  use  in  all 
operating  conditions;  that  they  facilitated 
qui  ckeruse;  and, that  if  items  wereskipped, 
they  could  be  more  easily  returned  to  than 
with  a  paper  checklist 

The  suggestion  of  using  automated  (elec¬ 
tronic)  checklists  wherever  possible  met 
with  a  positive  response.  Fifty-eight  point 
six  peroentof  the  respondents  felt  it  would 
be  helpful,  but  the  following  qualifica¬ 
tions  are  typical: 

“No  matter  how  they  are  presented,  au¬ 
tomated  or  clay  tablet,  they  must  be  read 
and  followed.” 

(This  indicates  that  at  least  one  of  the 
respondents  is  doubtful  that  reading  and 
following  checklists  is  done  consistently 
and  uniformly.) 

“I  don’t  like  the  idea  of  automated  or 
mechanical  lists  because  of  the  frequent 
changes  to  our  checklists.  The  cost  of 
changing  these  would  make  it  hander  to 
get  the  company  to  make  changes.” 

-  MECHANICAL  MARKERS 

The  suggestion  to  “use  a  mechanical 
marker  to  mark  checklist  progress"  met 
with  little  enthusiasm.  Many  felt  it  was  an 
archaic  concept  One  said  he  already  used 
one  -  “called  a  finger."  However,  in 
jumpseat  observation  rides  we  had  the 
opportunity  to  watch  a  crew  using  a  me¬ 
chanical  slide  checklist  for  “BEFORE 
TAKEOFF’and“BEFORE  LANDING." 
They  were  enthusiastic  about  it  felt  that  it 
provided  a  positive  indication  of  checklist 
progress,  raid  eliminated  the  problem  of 
losing  one’s  place  in  interrupted  check¬ 
lists. 

COLOR  CODING 

When  asked  if  they  felt  “use  of  color  coding 
for  easy  identification  of  checklists”  was  a 
good  idea,  83.7%  said  “Yes.”  This  is  used  by 
some  airlines,  both  Part  121  and  Part  135. 
Some  of  the  comments  elicited  were: 


-  “Our  current  procedure." 

-  “For  Emergency  checklist  at  least" 

3,4.4  Checklist  Interruptions 
Checklist  interruptions  come  in  two  varieties; 

•  Interruptions  to  checklist  use. 

•  Interruption  of  operational  tasks  by  checklist 
use,  such  as  can  occur  during  a  busy  approach 
or  an  emergency. 

While  most  of  the  respondents  felt  that  inter¬ 
ruptions  were  a  problem,  not  everyone  agreed. 
One  sheltered  soul  said; 


He  was,  however,  a  definite  minority  of  one,  in 
that  respect,  as  the  following  survey  results 
regarding  interruptions  will  show. 

The  respondents  were  questioned  about  the 
importance  of  potential  interruptions  to  check¬ 
list  use,  and  asked  to  rate  them  on  a  scale  of  1 
to  1 0,  with  1 0  indicating  very  important  While 
a  few  scored  some  of  those  listed  very  high,  the 
average  scores  were  middle  of  the  scale.  The 
top-ranked  four  were  as  follows: 

•  ATC  communications 

“ATC  should  be  educated/indoctrinated 
to  the  hazaid(s)  associated  with  multiple 
frequency  changes  (which  takes  attention 
from  the  checklists/]  ookoutdoctrin&havi- 
gating,  etc.)  during  descent/approach 
(VFR  and  in  the  weather).  This  also  el 
moves  the  pilot  not  flying  from  the  ‘net¬ 
work  ’  at  a  critical  time.  Frequency  chang¬ 
ing  requires  intense  attention  inside  the 
cockpit..." 

Others  voiced  similar  sentiments: 

“Most  disruptive  area  of  operation  and 
checklist  interruption:  ATC  transmission 
in  initial  approach  area.  ID  and  read  a 
checklist  between  CIVET  (52.4  miles  NE 
ofLAX)and  LAXona  VFR  day.  Typical 
to  have  six  frequency  changes,  a  dozen 


transmissions  while  ‘setting-up’  bugs  and 
radios  for  two  different  approaches,  and 
being  assigned  to  side-step  to  land  on  a 
third  runway.  Usually  flight  crew  cannot 
respond  as  controllergces  from  one  trans¬ 
mission  to  another  in  steady  stream  of 
clearances  and  modifications  to  clear¬ 
ances." 

•  Ground  personnel  communications 

Respondents  Identified  conversations  with  gate 
agents,  fuelers,  push-back  crews,  mechanics, 
etc. ,  as  disruptive  of  checklist  operations  prior 
to  taxi. 

•  Flight  attendant  requests 

One  respondent  felt  so  strongly  about  this 
source  of  interruption  that  he  scored  it  1 1  on  a 
scale  of  1  to  10,  and  most  felt  that  this  was  a 
problem  in  at  least  some  phases  of  operatioa 
There  was  no  agreement  on  which  phase  was 
most  affected.  One  respondent  said: 

' 'Interruptions  are  my  big  deal.  F/As  (flight 
attendants)  who  eitherdon’t  know  ordon’t 
care  what  you’re  doing,  ATC,  etc,  How 
do  you  stop  that?" 

•  External  taxiing  distractions 

This  coveted  everything  from  complex  airport 
layouts,  to  poorly  marked  taxi-  and  runways, 
to  other  airport  traffic.  A  major  contribution  to 
this  problem  is  ground  vehicles  which  do  not 
give  way  to  aircraft,  and  over  which  ground 
controllers  claim  to  have  no  authority. 

It  has  been  suggested  from  time  to  time  that 
taxiing  distractions  could  be  eliminated  by 
stopping  the  aircraft  until  the  checklist  was 
complete.  When  queried  about  this,  about 
72%  said  ‘‘No.’’  The  following  comments  are 
typical: 

-  “Very  difficult  to  stop  and  run  takeoff 
check  at  most  airports.” 

-  "Not  practical.” 

“Checklists  can  be  distracting  when  taxi¬ 
ing,  but  can  be  managed  safely.” 


-  “Pilots  are  capable  of  responding  while 
taxiing.’’ 

-  “We  can  walk  and  chew  gum.” 

The  consensus  seems  to  be  that  they  can 
handle  the  distractions.  However,  ASRS  and 
NTSB  data  indicate  that  distractions  may  be 
more  disruptive  thanmany  pilots  arc  willing  to 
admit 

This  last  category,  “External  taxiing  distrac¬ 
tions,”  also  contains  elements  of  tire  second 
type  of  interruption  —  that  of  the  checklist 
becoming  an  interruption  to  operational  tasks. 

Asked  if  they  felt  “there  are  times  when  the  use 
of  a  checklist  creates  an  interruption  to  good 
operating  procedures?”,  39%  said"  Yes.”  One 
felt  that  during  an  AbnormaVEmergeney  situ¬ 
ation  he  should  handle  the  problem  and  use  the 
checklist  when  and  if  he  had  time.  Another 
said  the  problem  was  worse  during  taxi  out 

“While  checklist  is  being  run  it  is  easy  to 
miss  radio  calls.  It  is  better  without  so 
much  dual  response.” 

A  report  from  the  All  Nippon  Airways  Flight 
Standards  Committee  quotes  the  1 979  NASA 
ASRS  9th  Quarterly  report,  concerning  check¬ 
lists  becoming  an  interruption  to  operational 
procedure.  And  an  analysis  from  that  9th 
Quarterly  report  of  ASRS  air  carrier  distrac¬ 
tion  reports  associated  with  checklists,  found 
two  characteristics  common  to  all  the  reports. 

1 .  “Every  report  indicated  that  checklist  ac¬ 
complishment  received  cockpit  priority 
over  ATC  requirements.  Every  incident 
ended  in  a  potential  or  actual  violation  of 
ATC  roles  or  regulations.” 

2.  “The  checklist  activity  was  almost  always 
going  on  at  the  same  time  other  cockpit 
tasks  were  being  performed;  radar  moni¬ 
toring,  minor  malfunctions,  system  op¬ 
eration,  traffic  watch,  etc.  Checklist  ac¬ 
complishment  became  a  cause  of  distrac¬ 
tion,  not  by  itself  but  as  a  part  of  cockpit 
workload.  In  the  incident(s)  reported,  the 
workload  became  ‘excessive’  and  ‘time 
ran  out’  before  all  tasks  could  be  com¬ 
pleted." 
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Clearly,  the  use  of  checklists  in  the  cock¬ 
pit  is  required  for  safe  operations.  Just  as 
clearly,  they  must  be  used  in  an  environ¬ 
ment  that  is  disruptive  and  promotes  error 
in  their  use.  At  the  same  time,  checklist 
use  is  an  important  contributor  to  cockpit 
workload.  Checklists  that  are  easy  to  read 
and  use  will  be  more  resistant  to  error  and 
will  contribute  less  to  cockpit  workload 
than  those  that  are  not 

3.45  Compliance,  Crewmember  Variations,  and 
Cocicprr  Resource  Management  (CRM) 

One  issue  that  surfaced  during  the  survey  was  that  of 
crew  compliance.  One  respondent  commented: 

“Checklists  are  not  that  important  A  bad  crew 
can  screw  up  a  good  checklist.  A  good  crew 
can  work  safely  with  any  checklist” 

Other  comments  included  were: 

•  “Checklists  are  mandatory  for  safety.  How¬ 
ever,  they  are  only  as  good  as  the  persons 
reading  them,” 

•  “Personal  discipline  seems  to  be  the  major 
variant” 

•  “Don’t  give  into  complacency  ••  it’s  our  big¬ 
gest  foe.” 

Though  the  overwhelming  majority  indicated  that 
their  airlines  prescribed  methods  of  checklist  use 
and  their  crews  adhered  to  them,  72.6%  also  felt  that 
individual  crewmembers  influenced  the  manner  in 
which  checklists  were  performed.  Sixty  point  five 
percent  felt  that  this  resulted  in  variations  in  check¬ 
list  performance,  and  43.6%  felt  that  this  meant 
checklists  were  done  in  a  nonprescribed  way,  or 
were  not  done.  There  appears  to  be  an  inconsistency 
in  these  responses.  Although  stating  that  most  crews 
followed  prescribed  procedure,  they  also  felt  that 
individuals  had  a  great  influence  on  the  manner  of 
checklist  performance.  The  following  comments 
shed  light  on  the  state  of  cockpit  resource  manage¬ 
ment  and  crew  coordination: 

•  “This  (the  lack  of  standard  use  or  nonuse)  will 
be  difficult  to  correct  until  the  attitude  of  those 
individuals  is  changed.” 

•  "Ourcaptains  are  so  nonstandard  that  the  First 
Officer's  job  is  much  more  difficult.  Our  air¬ 


line  provides  us  with  basically  good  proce¬ 
dures  and  checklists,  but  the  captains  (particu¬ 
larly  the  older  pilots)  refuse  to  use  them.” 

•  “Some  captains  continually  fail  to  call  for 
checklists,  leaving  it  up  to  the  other 
crewmembers  to  be  a  little  aggressive  and  ask 
if  they’re  ready  for  it  (die  checklist).” 

When  asked  if  their  airline  had  a  policy  of  Cockpit 
Resource  Management  (CRM),  73%  of  the  respon¬ 
dents  indicated  that  their  airline  had  adeflnite  policy. 
The  following  comments  are  representative,  al¬ 
though  contradictory. 

•  “Most  ‘old  heads’  don’t  even  understand  the 
concepts  in  CRM,  they  are  from  the  school  of 
Zeus.” 

•  “Our  airline  has  a  very  good  standard  operat¬ 
ing  procedure.  1  ven  though  the  Captain  has 
the  ultimate  authority,  all  crewmembers  are 
encouraged  to  actively  participate  in  cockpit 
operations  and  not  hesitate  to  voice  their  con¬ 
cerns  regarding  irregularities  or  any  sort  of 
’judgment’  call.” 

These  two  respondents  are  apparently  from  differ¬ 
ent  airlines,  which  espouse  different  philosophies 
on  CRM.  One  appears  to  have  a  strong,  definite 
policy  which  has  been  impressed  on  the  crews,  the 
other  either  no  CRM  policy,  or  policy  which  is  not 
being  followed. 

3.4.6  Checklist  Accessibility 
When  queried  about  the  checklists  they  currently 
use,  3 1  (35.6%  of  those  who  answered  the  question) 
felt  that  their  “Emergency”  checklists  were  not  easy 
to  locate  when  needed. 

•  “I  would  have  to  dig  into  my  flight  bag  for 
emergency  checklist  handbook.” 

•  “Emergency  checklists  should  be  red  for  all 
fleets/airlines  (color  coding)  and  should  be 
required  bv  FAA  to  be  readily  accessible 
(emphasis  added)  -  not  in  binders  in  flight 
bags.” 

•  “BAe- 146  needs  a  place  to  stow  both  ‘Nor¬ 
mal’  &  ‘Emergency’  checklists.” 

•  “Abiwrmal/Emeigencyinmanuals... difficult 
to  find.” 
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•  “I  would  like  to  see  a  card(s)  with  the  immedi¬ 
ate  action  emergency  procedures  with  their 
rone-memory  [sic]  reference  actions  in  the 
cockpit,  so  we  wouldn’t  have  to  be  finding  it  in 
a  book  at  a  critical,  busy  moment,’’ 

3.4.7  Other  Observations 
Although  almost  70%  said  that  they  had  a  personal 
“must  check”  list  which  they  used  in  addition  to  the 
formal  checklists,  only  about  1/2  felt  this  would  be 
useful  to  all  front-end  crews.  Whether  this  indicated 
that  they  felt  this  “must  check”  wouldn’t  work  with 
others,  orwene  reluctant  to  suggest  imposing  some¬ 
thing  else  on  other  crews,  was  not  clear. 

A  number  used  some  form  of  memory  jog  to  remind 
them  to  complete  some  items  on  a  checklist  (such  as 
when  taxiing  with  fewer  than  all  engines  operating). 
Examples  of  this  are  a  coffee  cup  inverted  over  the 
flap  handle,  the  checklist  between  the  throttles,  or  a 
“post-it”  note  on  the  windshield.  However,  62% 
said  they  just  repeat  the  entire  list.  From  the  perspec¬ 
tive  of  2 1 .5  years  in  airline  cockpits,  the  writer  rinds 
this  difficult  to  believe.  We  think  20%  would  be 
closer  to  the  actual  number. 

When  asked  if  their  procedures  were  such  that  they 
found  themselves  reading  checklists  during  periods 
of  high  workload,  62.5%  said  “Yes.”  The  manner  in 
which  they  coped  with  this  is  cause  for  alarm .  While 
many  said  they  stopped  the  checklist  until  they  had 
more  time,  30%  said  they  “press  on  and  hope  that 
nothing  gets  missed.”  To  again  quote  John  Lauber 
in  his  Flight  Safety  Foundation  address  -  “Another 
step  involves  the  question  of  handling  disruptions  or 
distractions,  some  of  which  are  notunderthe  control 
of  the  crew,  and  others  of  which  are.  It  must  be 
recognized  that  any  disruption  or  interruption  of 
sequentially  dependent  tasks  is  associated  with  a 
high  probability  that  some  or  all  of  the  elements  of 
these  tasks  may  be  missed  entirely,  especially  if  a 
significant  amount  of  time  passes  during  the  period 
of  interruption.  Thus,  operating  procedures  should 
explicitly  state  that  any  interruption  to  an  ongoing 
sequence  of  activities,  especially  running  check¬ 
lists,  will  automatically  trigger  a  restart  of  the  pro¬ 
cess  which  was  interrupted.  Obviously,  this  has  to 
be  done  in  a  reasonable  manner,  but  it  should  be  the 
dominant  mode  of  operation  for  all  pilots.” 

Responses  to  one  survey  question  indicate  that  most 
crews  follow  the  standard  company  procedures  for 
checklist  use.  However,  when  asked  later  whether 
individual  crewmembers  influence  the  manner  in 


which  checklists  are  used,  a  majority  of  the  respon¬ 
dents  responded  affirmatively.  The  following  com¬ 
ment  is  a  case  in  point: 

“Some  two-man  crews  tend  to  abbreviate  or 
use  silent  checklists  during  high  workload 
times.” 

Our  own  cockpit  experience  reflects  the  fact  that 
two-man  crows  tend  to  be  less  formal  operationally 
than  three-man  crews,  and  the  above  comment  sup  • 
ports  this. 

The  suggestion  of  a  core  checklist  with  allowable 
variations  for  aircraft  type  and  operating  environ¬ 
ment  elfeited  mixed  responses.  The  comments  ranged 
from  negative,  to  advisory,  to  positive.  Some  com¬ 
ments  were: 

•  “A  large  group  of  pilots  will  never  agree  on 
anything.” 

•  “An  industty  standard  checklist  will  accom¬ 
modate  the  lowest  common  denominator.” 
(This  ties  in  with  an  ASRS  report  received 
which  cites  a  fleet  with  generic  checklists.  The 
writer  complained  of  illogical  flow  patterns 
resulting  from  an  attempt  to  accommodate 
different  aircraft  types,  and  of  PA  announce¬ 
ments  on  final  approach.) 

•  “Would  allow  less  confusion  when  moving  to 
different  aircraft.”' 

•  “This  should  be  done  with  much  input  from 
line  pilots.  Not  supervisory  types  and  inspec¬ 
tors  who  do  not  have  the  experience.  I’ve  been 
in  both  situations.” 

The  section  requesting  suggestions  from  the  respon¬ 
dents  to  improve  checklists  elicited  many  com¬ 
ments.  The  following  representative  comments  are 
quoted  as  received. 

■  “Keep  them  as  brief  and  simple  as  possible.” 

•  “State  of  the  art  -  electronic  checklists  with 
throttle  interlock  (for  critical  items  such  as 
gear  and  flaps)  for T/O  (takeoff)  and  landing." 
(Four  of  the  respondents  suggested  some  ver¬ 
sion  of  this.) 

•  “Lastitemsonpre-takeoff:killeritemsdouble- 
checked.  Pan  Am  uses  this.”  These  would 
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include  items  which  if  not  properly  checked, 
could  pose  imminent  danger  to  aircraft,  crew, 
or  passengers,  as  well  as  damage  to  persons  or 
property  on  the  ground  during  takeoff  or  land¬ 
ing.  Examples  of  these  would  include  fuel 
quantity  and  flaps  chi  the  "BEFORE  TAKE¬ 
OFF’  checklist  and  flaps  and  gear  on  the 
“BEFORE  LANDING”  checklist. 

•  “Checklists  arc  like  things-to-do  lists.  They're 
only  helpful  if  you  remember  to  look  at  them. 
Checklists  get  forgotten  in  entirety.  If  a  key¬ 
board  response  was  required  for  each  item  on 
a  ‘BEFORE  START*  checklist  before  the 
engine  start  valve  would  open,  that  checklist 
could  not  be  forgotten,  etc.” 

•  “We  have  to ‘sell’ the  average  line  pilot  that  it 
is  professional  as  well  as  ‘cool/manly,  etc.  ’,  to 
accomplish  each  checklist  thoroughly  every 
time!  We  have  to  show  how  it  will  help  the 
flight  crewmember  himself  to  do  the  check¬ 
list” 

•  “In  some  fleets,  skipping  checklist  items  is 
routine  because  of  the  design  of  the  checklist 
That’s  whereeither  the  checklist  or  the  proce¬ 
dure  should  be  changed.”  (emphasis  added) 

•  “My  company  management  pilots  need  to 
more  strongly  endorse  checklist  importance 
and  standardization.” 

•  “Our  airline  has  excellent  checklists  and  pro¬ 
cedures  which  are  carefully  followed  by  crews. 
Errors  still  creep  in.” 

«  “We  must  expect  errors,  and  plan  and  design 
knowing  there  will  be  errors." 

•  “We  don’t  need  another  gadget  to  check  T/O 
warning  systems.  A  specific  ‘Killer  Item’ 
recheck  is  appropriate.” 

•  “Checklists  must  cover  a  dead  tired  crew.” 

•  “Brevity  and  simplicity.” 

3.4.8  Summary  of  Findings 

From  this  survey,  we  may  draw  some  conclusions 

regarding  checklists  in  everyday  use. 

•  Larger  print  and/or  better  letter  spacing  on 
checklists  would  be  desirable. 


•  The  small  sample  of  respondents  who  use 
CRTs  for  checklists  find  them  preferable  to 
other  types  of  checklists.  They  all  feel  that  the 
CRT  checklists  are  easier  to  use  overall  code- 
pit  lighting  conditions;  that  they  are  easier  to 
get  at;  that  they  are  easier  to  use  over  all 
operating  conditions;  that  they  facilitate  quicker 
use;  and  that  if  items  are  skipped,  they  can  be 
returned  to  more  easily  than  with  a  paper 
checklist 

Our  discussions  with  some  corporate  users  of 
electronic  checklists  revealed  a  negative  side 
to  thesedevices.  They  itxiicate  that  CRT check¬ 
lists  can  be  more  difficult  to  use;  that  they  can 
require  a  great  deal  of  heads -down  time;  and 
that  it  is  cumbersome  to  return  to  skipped 
items. 

•  Pilotsfeltthatthecreationofa“core”checklist 
across  industry  lines  would  only  meet  the 
“lowest  commondenominator”  and  thus  would 
penalize  the  innovators  and  the  conscientious. 

•  Color-coding  for  easy  recognition  of  check¬ 
lists  was  reported  to  bedesirable  and  is  already 
being  used  by  some  operators.  This  takes 
different  forms,  from  colored  borders  on  check¬ 
list  cards,  to  solid  colored  cards,  to  colored 
folders  to  hold  the  cards.  Variations  of  all  of 
these  are  being  used  by  airlines  at  present 

•  There  are  many  sources  of  interruption  to 
checklists.  Some,  such  as  multiple  ATC  com¬ 
munications  at  inappropriate  times,  are  re¬ 
ported  as  causing  distractions  and  increasing 
workloads. 

•  Mostoftheairiineswhichweiecoveredinthis 
survey  were  reported  to  have  a  policy  for  the 
use  of  checklists  which  the  crews  followed. 
However,  1/2  of  the  respondents  stated  that 
individuals  in  the  cockpit  influenced  whether 
checklists  were  done  correctly,  or  at  all.  This 
indicates  a  lack  of  compliance  which  should 
be  addressed  by  the  airlines. 

•  The  survey  questions  concerning  procedures 
fofusingchecklistsverifyourconcemsthat,in 
fact,  checklists  are  used  in  an  environment  that 
prevents  crews  from  dedicating  predictable 
chunks  of  their  attention  to  the  completion  of 
these  lists,  and  that  they  accomplish  these  lists 
under  conditions  that  are  ideal  for  causing 
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mistakes.  Rather  than  dedicating  chunks  of 
time  to  checklist  use,  many  crews  perform 
these  lists  concurrent!  y  with  other  flighltasks. 
About  1/3  of  those  who  responded  that  they 
found  themselves  doing  checklists  at  times  of 
otherwise  heavy  workload  said  that  they  con¬ 
tinued  with  foe  checklist  as  they  did  other 
tasks,  completing  checklist  items  as  they  found 
time. 

•  Emergency  checklists  are  often  not  easily 
located  when  needed.  It  was  suggested  that  it 
be  made  mandatory  for  them  to  be  earned  in  a 
readily  accessible  place  in  foe  cockpit,  rather 
than  within  a  manual  in  a  flight  bag. 

3J5  OTHER  SOURCES  OF  INFORMATION 

33.1  NTSB  and  Related  Meetings 
We  participated  in  discussions  with  an  investigator 
for  the  NTSB  and  representatives  of  a  regional  Part 
121  carrier  who  were  developing  anew  checklist  for 
a  foreign  manufactured  aircraft  that  they  had  in 
service.  The  carrier’s  people  expressed  their  con¬ 
cerns  with  the  manuals  and  checklists  that  are  avail¬ 
able  for  use  with  the  foreign  manufactured  aircraft 
that  they  are  operating.  We  subsequently  reviewed 
the  AFMs  and  checklists  for  those  aircraft. 

One  aircraft  type  had  an  AFM  that  covered  the 
information  required  by  foe  FARs;  e.g.,  Limita¬ 
tions,  Emergencies,  and  Performance  (the  greater 
part  of  foe  manual  was  devoted  to  performance). 
There  was  also  a  Normal  section  which  encom¬ 
passed  ‘'Normal"  and  “Abnormal”  checklists.  No 
systems  descriptions  were  included.  Other  concerns 
and  problems  that  this  operator  expressed  included 
the  following: 

•  One  AFM  contained  82  checklists  for  abnor¬ 
mal  and  emergency  situations.  Of  the  82, 39 
were  “Emergency”  checklists.  Many  of  the 
39,  such  as  “UNPRESSURIZED  FLIGHT,” 
would  not  have  been  classified  “Emergency” 
checklists  by  many  U.S.  manufacturers  or 
airlines.  However,  the  operators  are  constrained 
to  use  these  checklists  as  they  stand,  with  their 
multiple  memory  items,  which  put  a  heavy 
memory  load  on  their  sometimes  low-experi¬ 
ence-level  crews.  We  quote  from  an  Advisory 
Notice  from  the  manufacturer  pertaining  to 
these  checklists: 

“Operators  are  reminded  that  abbreviated 


checklists  (as  opposed  to  lengthy,  detailed 
expanded  checklists)  are  not  published  by 

_ as  a  document  approved  by  an 

Airworthiness  Authority  and,  if  they  are  to  be 
used,  they  must  comply  at  all  times  with 
current  procedures  as  set  forth  in  foe  latest 
revision  of  the  Approved  Flight  Manual.” 

FAR  125.75  states  that  “...the  certificate  holder 
may  re  vise.. .if  foe  revised  operating  proce¬ 
dures  and  modified  performance  data  presen¬ 
tation  are  approved  by  foe  Administrator.” 
This  regional  operator  told  us,  however,  that 
they  had  little  luck  trying  to  modify  these 
manuals  and  checklists.  Whether  due  to  poor 
operator  modifications  or  reluctance  on  foe 
part  of  the  POI  to  allow  change,  we  don’t 
know. 

•  This  aircraft,  since  itsmanufacture  (4+ years), 
has  had  an  average  of  300  modifications  per 
year.  Some  of  these  modifications  involve 
majorhardware  changes  orprocedural  changes 
that  necessitate  checklist  changes.  Because  of 
foe  volume  of  changes,  the  operator  has  found 
it  difficult  to  modify  the  aircraft,  keep  their 
crews  adequately  informed,  and  make  timely 
changes  to  manuals  and  checklists  which  then 
must  undergo  POI  approval. 

33.2  Am  Transport  Association  (ATA)  Flight 
Crew  Checklist  Working  Group  Meetings 
The  ATA  hosted  a  working  group  on  checklist  and 
manual  design  to  work  with  the  FAA  in  developing 
guidelines  for  use  by  POIs  in  evaluating  Part  121 
and  Part  135  manuals  and  checklists.  This  group 
was  assembled  to  provide  foe  FAA  with  industry 
input  for  the  checklist  and  manual  section  of  foe 
Draft  Inspectors’  Handbook.  We  were  invited  to 
participate. 

Prior  to  the  two  meetings  that  we  attended,  we  met 
with  the  FAA  member  responsible  for  writing  this 
section  of  the  Handbook.  We  provided  him  with 
data  we  had  found  on  recent  MIL  SPECS  which 
provided  guidance  in  manual  and  checklist  con¬ 
struction  (M1L-M-7700C,  18  May  1989,  MIL-C- 
81222C  [AS],  22  Feb.  1978,  MIL-C-27278B,  5  July 
1973).  In  addition,  we  advised  him  of  checklist  and 
manual  problems  that  we  had  encountered  in  meet¬ 
ings  and  discussions  with  airlines.  He,  in  turn, 
provided  us  with  the  results  of  the  first  Flight  Crew 
Checklist  Working  Group  meeting,  which  we  had 
missed.  This  included  the  progress  to  date  on  the 
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writing  of  the  Handbook.  Also  included  was  yritten 
input  he  had  solicited  from  the  airline  representa¬ 
tives  regarding  their  positions  on  manuals  and  check¬ 
lists,  and  input  for  possible  use  in  the  Handbook. 

Since  this  section  of  the  Draft  Inspectors'  Hand - 
book  was  something  which  would  govern  their 
manuals  and  checklists  for  the  foreseeable  future, 
the  airlines  participated  actively.  Their  views  were 
understandably  quite  parochial,  and  included  much 
debate  on  semantics,  to  eliminate,  as  far  as  possible, 
any  but  very  narrow  interpretations  by  POIs.  There 
was  general  agreement  among  the  airlines  that  if  it 
were  not  necessary  to  mention  a  specific  point  in  the 
handbook,  it  should  be  left  out  completely,  rather 
than  having  a  general  statement  subject  to  varying 
interpretations. 

3.5  J  Jumpseat  Observation  Rides 
We  took  jumpseat  observation  rides  on  seven  occa¬ 
sions,  on  four  different  airlines.  We  did  this  to  see 
how  checklists  were  actually  being  used  in  flight. 
The  aircraft  flown  included  two  DC-9s,  a  MD-80,  a 
DC-10,  a  L-101 1 ,  a  B-727,  and  a  Saab- 340.  None  of 
the  aircraft  used  a  computerized  checklist  on  a  CRT. 
All  used  paper  “Normal”  checklist  cards  in  varying 
sizes.  On  three  aircraft,  a  mechanical  checklist  was 
used  for  the  “BEFORE  TAKEOFF”  and  “BEFORE 
LANDING”  checklists.  The  crews  using  these  me¬ 
chanical  checklists  were  highly  in  favor  of  them. 

The  manner  in  which  the  checklists  were  performed 
varied  widely.  Three  crews  from  the  same  airline 
performed  inaunifotm  manner,  indicatingthorough, 
standardized  training.  Two  crews  of  another  airline 
performed  in  a  loose  manner  —  sufficiently  loose 
that  one  of  them  never  ran  the  “BEFORE 
LANDING”  checklist 

It  appeared,  from  these  jumpseat  rides,  that  the 
performance  of  checklists  in  an  airline  that  has  a 
strong  emphasis  on  training  and  standardization 
will  be  more  likely  to  be  uniform.  Where  less 
emphasis  is  placed  on  those  factors,  and  less  disci¬ 
pline  prevails,  checklist  use  will  be  correspondingly 
more  variable. 

3.5.4  Corporate  On-Site  Visits 
Corporate  aviation  often  makes  use  of  the  latest 
technology  before  the  airlines,  since  corporations 
are  not  subject  to  the  economic  constraints  imposed 
by  a  large  fleet  They  also  frequently  cany  execu¬ 
tives  whose  loss  to  the  company  in  an  accident  could 
be  critical.  We  believe  this  colors  their  thinking 


regarding  technology  vs.  cost  decisions.  Interested 
in  this  tendency  to  use  the  newest  equipment  we 
made  on-site  visits  to  two  corporate  aviation  depart¬ 
ments  to  assess  their  current  checklist  technology.  A 
peculiarity  of  corporate  aviation  departments  is  that 
they  can  change  their  checklists  whenever  they 
want,  as  they  see  fit,  and  without  prior  approval, 
since  they  operate  under  Part  91. 

One  corporation  flew  two  Canadairs  and  one 
Westwind.  All  three  aircraft,  at  the  time  of  our  visit, 
used  a  backlit,  fold  down,  scroll  checklist  for  all 
“Normal”  checklists.  This  was  mounted  in  the  cen¬ 
ter  of  the  glare  shield.  The  pilots  reported  that  they 
liked  it,  as  they  always  knew  where  they  were  in  the 
checklists,  regardless  of  interruptions.  “Emergency” 
and  “Abnormal”  checklists  were  carried  in  the '  ock- 
pit,  in  a  laminated,  color-coded,  well-tabbe^  book¬ 
let  prepared  by  Hight  Safety  Canada,  Inc.  This 
booklet  also  contained  backup  “Normal”  checklists 
foruse  if  the  scroll  was  inoperative.  These  “Normal” 
checklists  were  not  as  comprehensive  as  the 
corporation’s  own,  used  on  the  scroll.  All  three 
aircraft  have  the  capability  of  upgrading  to  auto¬ 
mated  checklists  on  CRTs,  and  the  corporation 
stated  their  intent  to  do  this  in  the  near  future.  Since 
the  checklists  would  usurp  the  radar  presentation,  in 
bad  weather  the  crew  would  revert  to  the  scrolls. 

The  other  corporation  had  a  larger  aviation  depart¬ 
ment  encompassing  a  Gulfstream  G-4,  a  Westwind 
1  and  2,  a  Beech  King  Air,  and  a  number  of  Bell  Jet 
Ranger  and  Bell  222  helicopters.  The  fixed  wing 
aircraft  all  require  two  pilots.  The  only  case  where 
a  rotary  wing  aircraft  requires  two  pilots  is  the  222 
in  IFR  weather. 

All  their  aircraft  used  laminated  card  checklists, 
despite  the  fact  that  the  Westwind  2  had  checklists 
available  on  the  radar  CRT.  The  reason  given  by  the 
chief  pilot  was  standardization.  He  also  felt  that  the 
CRT  checklists  were  more  cumbetsome  to  use,  and 
took  more  time. 

The  G-4  will  have  the  automated  checklists  installed 
in  its  Sperry,  all-glass  cockpit  this  year.  It  will  have 
a  dedicated  CRT.  Whether  that  installation  will 
supplant  the  laminated  cards  remains  to  be  seen. 

The  rotary  wing  aircraft  crews  did  not  use  available 
checklists  when  underway.  The  only  check  nor¬ 
mally  done  when  underway  is  an  engine  gauge 
check  on  descent.  During  an  engine  loss  or  tail  rotor 
failure,  the  crew  is  too  busy  to  read  a  checklist.  We 
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were  told  that  they  deal  with  “Abnormal”  proce¬ 
dures  instinctively,  from  an  ingrained  habit,  and 
then  refer  to  the  Operations  Manual  kept  in  the 
aircraft  Checklists  are  also  not  used  in  two  pilot  IFR 
flights,  where  each  pilot  knows  the  Standard  Oper¬ 
ating  Procedure  and  follows  it  when  underway. 
Although  we  anticipated  that  we  might  find  ex¬ 
amples  of  the  latest  technology  in  checklists  in  these 
visits,  we  did  not.  As  noted  above  there  was  some 
interest  in  automated  checklists  on  CRTs,  but  for  the 
most  part  more  conventional  types  were  the  stan¬ 
dard. 

3.5.5  Cockpit  Devices  in  Use 
In  order  to  determine  whether  there  was  some  new 
technology  available  which  could  be  easily  adapted 
to  general  use,  and  could  help  to  eliminate  checklist 
errors,  we  did  a  small  survey  of  what  was  available. 
From  the  results  of  this  survey,  we  have  listed 
advantages  and  disadvantages  of  the  various  kinds 
surveyed  (see  Appendix  B). 

The  automated  checklist  on  a  CRT  is  liked  by  many 
of  those  who  use  it.  Some  who  use  it  on  a  regular 
basis  and  report  favorably  on  it  also  report  that  it  can 
take  more  heads-down  time  if  anything  unplanned 
or  out  of  the  ordinary  occurs.  Others  report  it  as  too 
cumbersome  and  use  paper  or  laminated  checklists 
instead,  even  when  the  other  technology  is  avail¬ 
able.  In  some  cases,  it  usurps  the  radar  CRT.  Many 
aircraft  would  require  a  very  costly  retrofit  to  enable 
the  use  of  this  technology. 

The  checklist  on  a  scroll  has  been  around  for  many 
years,  and  is  still  used  enthusiastically  by  many, 
including  crews  of  some  Air  Force  planes  in  the 
current  inventory.  It  can  be  cumbersome  to  use  if 
one  needs  to  return  to  a  prior  portion  of  the  checkli  st. 
It  also  takes  up  cockpit  space,  which  is  in  short 
supply  in  many  aircraft  In  addition,  it  needs  a  paper 
checklist  backup  in  case  of  mechanical  failure.  One 
corporation  we  visited  used  scroll  checklists  that 
were  generated  on  a  personal  computer  with  a  dot 
matrix  printer  —  not  the  best  combination  for  leg¬ 
ibility.  Their  checklists  did  not  require  approval 
from  a  POI  since  corporations  operate  under  Part  9 1 , 
and  this  allowed  them  to  make  changes  as  they  saw 
fit.  Their  preflight  checklist  contained  129  items, 
and  other  checklists  also  seemed  excessively  long. 

By  far  the  most  prevalent  types  of  checklists  are 
paper  or  laminated  paper.  They  come  in  various 
sizes  and  shapes,  some  big  and  unwieldy,  some  so 
small  as  to  be  unreadable  except  in  perfect  condi¬ 


tions.  One  major  problem  with  these  is  the  ease  with 
which  you  can  lose  your  place  through  interrup¬ 
tions. 

We  observed  that  mechanical  checklists  are  used  for 
“BEFORE  TAKEOFF’  and  “BEFORE  LAND¬ 
ING.”  Their  users  like  them  since  they  are  a  positive 
measure  of  checklist  progress.  The  other  “Normal" 
checklists  that  the  crews  use  are  paper  or  laminated 
cards. 

We  have  seen  one  example  of  a  unit  which  reads  the 
checklists  to  the  user  in  a  synthesized  voice.  It  will 
restate  missed  items  until  they  are  complete,  if 
programmed  to  do  so.  As  far  as  we  know,  it  is 
currently  only  in  limited  use,  with  some  corporate 
Part  91  operators.  One  major  airline  is  considering 
doing  an  evaluation  of  this  technology  with  an  eye 
to  possible  use.  One  drawback  that  we  can  foresee  is 
the  addition  of  another  noise  in  cockpits  which  are 
already  noisy  enough. 

Some  users  kept  all  checklists  in  booklets  in  the 
cockpit.  Some  checklists  were  partially  laminated 
throughout,  some  were  in  plastic  sleeves.  Those  that 
were  well  tabbed  and  indexed  were  easy  to  use.  One 
of  the  best  examples  of  these  was  the  checklist 
booklet  from  Flight  Safety  Canada,  Inc.,  for  use  in 
the  Canadair  Challenger  601.  This  included  color- 
coded,  laminated  tabs,  well-indexed  “Abnormal" 
and  “Emergency”  sections,  and  heavy,  hard-fin¬ 
ished  paper  pages  with  10-point  type  or  larger.  It 
was  easy  to  use  and  very  legible.  Moreover,  the 
aircraft  for  which  it  was  designed  had  a  convenient 
storage  slot  for  it;  its  compactness  would  make  it 
easy  to  adapt  other  aircraft  to  accommodate  it. 

The  worst  example  we  saw  was  that  of  the  checklist 
booklet  from  the  Horizon  DHC-8  involved  in  an 
accident  at  the  Seattle-Tacoma  International  Air¬ 
port,  on  4/15/88.  It  was  printed  in  eight-point  type, 
mixed  case  (sometimes  all  lowercase),  and  not  good 
quality  of  print.  The  tabbing  can  best  be  explained 
by  quoting  from  the  NTSB  “Human  Performance 
Investigator’s  Factual  Report”  of  the  accident; 

“Locating  a  specific  checklist  requires  the  user 
to  identify  the  desired  checklist  in  the  table  of 
contents,  note  the  number  of  the  divider  at 
which  the  checklist  is  filed,  and  turn  to  the 
desired  checklist  which  is  inserted  before  (for¬ 
ward  of)  the  numbered  divider.” 
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In  a  drill,  at  an  informal  meeting  with  the  NTSB,  a 
DHC-8  Captain  was  asked  to  locate  the  “ENGINE 
FIRE”  checklist  in  the  Horizon  booklet.  He  was 
unable  to  do  so  in  a  reasonable  amount  of  time.  This 
inability  to  locate  critical  checklists  is  perhaps  one 
reason  why  the  “ENGINE  FIRE”  checklist  was 
never  completed  in  the  Horizon  accident. 

3.5.6  Summary  or  Findings 
Apart  from  paper  and  laminated  card,  no  checklist 
devices  were  found  which  were  easily  adaptable  to 
all  aircraft  types.  And,  one  respondent  to  the  ALPA 
survey  commented  that  the  aircraft  he  flew  didn’t 
even  have  a  place  to  stow  them. 

As  far  as  we  can  see,  no  manual  device  currently  in 
use  has  the  potential,  by  itself,  to  entirely  eliminate 
pilot  error  in  the  use  of  checklists. 

4.  SUMMARY  AND  RECOMMENDA¬ 
TIONS 

This  includes  a  summary  of  the  data  gathered  and 
recommendations  for  improving  checklists. 

4.1  FINDINGS 

4.1.1  Conformance 

Twenty  of  21  NTSB  reports  illustrate  that  lack  of 
conformance  with  standard  operating  procedures 
may  be  as  big  a  problem  as  checklist  layout  and 
design,  if  not  bigger.  Forty-three  percent  of  the 
ASKS  reports  indicate  that  a  lack  of  training  contrib¬ 
uted  to  this  lack  of  conform anoe.  Comments  by 
ALP  A  support  this  indication.  We  observed  an 
instance  of  this  during  one  of  our  jumpseat  rides 
where  the  crew  did  not  read  their“BEFORE  LAND¬ 
ING”  checklist. 

The  inconsistent  application  of  policies  and  proce¬ 
dures  for  checklist  use  may  also  adversely  affect 
conformity.  Some  operators  were  very  specific  in 
the  guidance  they  gave  their  crews,  others  gave  no 
direction  on  eitherpolicy  orprocedures  for  checklist 
use.  The  latter  were  frequently  vague  as  to  who 
challenges,  who  responds,  and  whea 

41.2  Interruptions 

Fifty-eight  percent  of  the  ASRS  reports  mentioned 
interruptions  as  being  the  cause  of  problems  in 
checklist  use.  The  interruptions  fall  into  two  catego¬ 
ries: 


use  of  a  checklist 

•  Interruptions  to  operational  tasks  caused  by 
using  a  ciiecklist 

The  ALPA  survey  confirmed  the  disrupted 
and  disrupting  aspects  of  checklist  use  and  its 
implications  for  flight  safety. 

We  also  observed  that  operations  activities 
often  led  to  checklists  being  done  from 
memory,  responses  being  given  without  the 
corresponding  action  being  taken,  and  check¬ 
list  items  being  missed.  Similarly,  our  cockpit 
observations  revealed  that  diligent  useofcheck- 
lists  by  flight  crews  while  taxiing  could  easily 
detract  from  the  safe  operation  of  the  aircraft 
on  the  ground. 

4.1  J  Checklist  and  Manual  Design,  Organiza¬ 
tion,  and  Contents 

Missing,  inconsistent,  and  incorrect  procedures  were 
said  to  contribute  to  20%  of  the  problems  in  the 
ASRS  reports.  In  fact,  we  found  many  of  these 
problems  in  our  review  of  Part  121  and  Part  135 
operators’  manuals  and  checklists.  And  many  of 
these  manuals  and  checklists  also  lacked  organiza¬ 
tion  and  the  completeness  needed  to  support  in¬ 
formed  use  by  flight  crews.  The  manuals  and  check¬ 
lists  provided  by  large  U.S.  manufacturers  were 
usually  more  organized  and  easier  to  use  than  those 
from  foreign  or  small  U.S.  manufacturers.  The  lack 
of  organization  and  cl  arity  in  the  manuals  and  check¬ 
lists  from  the  smaller  and  foreign  manufacturers 
often  presented  a  problem  for  regional  carriers  fly¬ 
ing  the  smaller,  commuter-type  aircraft.  However, 
even  the  manuals  and  checklists  from  large  U.S. 
manufacturers  suffered  at  times  from  changes  made 
by  the  operators.  This  resulted  in  an  end  product  that 
was  no  better,  and  occasionally  worse,  than  what 
was  available  to  small  carrier  crews. 

Examples  of  the  problem  found  included  me  follow¬ 
ing: 

•  checklist  procedures  not  in  the  order  in  which 
they  should  be  used; 

•  items  missing  from  checklists  and/or  not  car¬ 
ried  over  from  the  AFM; 

•  procedures  specified  in  the  Airplane  Flight 
Manuals  (AFMs)  inconsistent  with  actions 
prescribed  in  the  operating  checklists; 


External  interruptions  to  the  crew  during  their 
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•  whole  sets  of  procedures  not  carried  over  from 
the  AFM  to  the  operating  checklists; 

•  incomplete  procedures; 

•  checklists  difficult  to  locate  in  manuals  either 
because  of  poor  tabbing,  poor  indexing,  or 
poor  titles. 

4.1.4  Readability 

The  typography  of  manuals  and  checklists  varied 
widely,  from  five-point  type  to  10-point  type  or 
larger,  the  smaller  type  being  difficult  to  read.  Often 
print  was  blurred,  and  contrast  of  print  to  back¬ 
ground  poor,  despite  the  obvious  fact  that  if  manuals 
and  checklists  are  difficult  to  read,  they  will  be 
difficult  to  use.  The  Air  Carrier  Operations  Bulletin 
Part  135  No.  88-5  -  Flight  Crew  Checklists  (NTSB 
Safety  Recommendation  A-88-72.)  says: 

a.  “The  National  Transportation  Safety  Board 
(NTSB)  in  their  investigation  of  a  commuter 
air  carrier  accident  discovered  that  the  flight 
crew  checklist  was  not  constructed  in  such  a 
manner  that  would  provide  adequate  legibility 
in  normal  or  emergency  conditions.  NTSB 
believes  that  under  operational  circumstances, 
a  deficiency  in  legibility  and  size  of  print  could 
compromise  the  intended  use  of  this  device. 

b.  Principal  operations  inspectors  should  take 
appropriate  actions  during  the  course  of  rou¬ 
tine  air  carrier  surveillance,  inspections,  or 
flight  checks  of  their  assigned  operators  for 
reviewof  current  checklist  formaL  Flightcrew 
checklists  used  by  air  carriers  should  include 
the  appropriate  actions  necessary  for  normal 
and  emergency  procedures,  printed  in  clear, 
concise,  and  legible  form.” 

‘x>ugh  directed  at  Part  1 35  operators,  this  applies 
to  all  operators.  The  regulations  should  be  changed 
to  reflect  the  same  standards  for  Parts  121  and  135 
operators.  The  current  regulations  reflect  a  lack  of 
clear  and  consistent  direction  for  manufacturers, 
operators,  and  POIs  alike.  Themanufacturers  should 
have  clear  guidelines  to  follow  in  producing  usable 
manuals  and  checklists  for  new  aircraft  Thfe  opera¬ 
tors  should  have  clear  manuals  and  checklists  for 
their  crews.  And  the  POIs  and  evaluation  groups 
should  be  given  unambiguous  guidance  on  what 
standards  to  apply  to  the  design  of  manuals  and 
checklists. 


4.1.5  Color  Coding 

Color  coding  of  checklists  and  manuals  is  used  very 
little,  although  it  could  facilitate  location  of  a  critical 
checklist  The  airlines  usually  cite  cost  as  the  reason 
for  not  using  color  coding. 

4.1.6  Inconsistency 

Often  there  was  a  lack  of  consistency  between 
AFMs  and  checklists.  In  some  cases,  checklist  items 
and  even  some  procedures  were  not  carried  over 
from  the  AFMs  to  the  operating  checklists. 

4.1.7  Definition  op  “Abnormal”  and  “Emergency” 
The  use  of  the  terms  “ABNORMAL”  and  “EMER¬ 
GENCY”  were  inconsistent  among  manufacturers 
and  operators  and  from  aircraft  type  to  aircraft  type 
within  the  same  operator’s  fleet.  The  use  of  “NOR¬ 
MAL,”  “ABNORMAL,”  and  “EMERGENCY”  is 
sometimes  inconsistent  throughout  a  fleet.  The  terms 
themselves  vary,  with  the  terms  “NON  NORMAL” 
and  “IRREGULAR”  used  somewhat  interchange¬ 
ably  with  ABNORMAL”  and  “EMERGENCY," 
but  there  are  also  differences  in  meaning. 

The  lack  of  a  standard  definition  for  “emergency” 
has  created  particular  problems  for  checklist  design. 
Excessive  numbers  of  emergencies  result  in  emer¬ 
gency  checklists  of  extreme  length,  excessive  num¬ 
bers  of  memory  items,  and  inconsistent  responses  to 
real  emergencies  that  are  not  always  so  labeled,  e.g. , 
loss  of  all  generators.  One  foreign  aircraft  that  had 
39  sets  of  “Emergency”  procedures,  many  of  which 
would  have  been  classified  “Abnormal”  by  major 
U.S.  manufacturers.  Inflight  events  that  are  classi¬ 
fied  as  emergencies  (for  example,  low-level 
unpressurized  flight)  in  one  aircraft  type  but  not 
another  in  the  same  fleet  reduces  the  flight  crews’ 
respect  for  the  term  and  contributes  to  their  confu¬ 
sion  regarding  their  priorities  for  action. 

4.1.8  Emergency  Checklists 

“Emergency”  checklists  are  sometimes  difficult  to 
locate  when  needed.  They  are  often  in  manuals 
stowed  in  flight  bags  and  are  reported  to  be  difficult 
to  retrieve. 

In  some  cases  in  our  study,  we  encountered  groups 
of  “Emergency”  checklists  that  had  an  excessive 
number  of  checklists  (39  in  one  case).  This  made  the 
checklists  cumbersome  to  use  and  made  it  more 
difficult  to  find  a  single  checklist. 

4.1.9  H eads-Down  Time 

The  use  of  CRT-presented  rather  than  hand-held 
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checklists  may  be  expected  to  increase  flight  crew 
heads-down  time.  This,  coupled  with  the  amount  of 
heads -down  time  necessary  forjeprogramniing  com¬ 
puters  when  changes  of  routing  are  received,  could 
cause  important  decreases  in  the  capability  of  the 
crew  to  concentrate  on  other  duties  such  as  monitor¬ 
ing  traffic. 

4.1.10  Summary  op  Factors  Detracting  from 
Good  Checklist  Design  and  Use 

Flight  deck  observations,  pilot  reports,  relevant  avia¬ 
tion  safety  databases,  and  our  review  of  checklists 
and  handbooks  currently  in  use  by  some  air  carriers 
indicate: 

•  Operational  conditions  and  priorities  limit  the 
time  available  to  flight  crews  for  examining 
checklist  items. 

•  Use  of  checklists  involves  flight  crew  heads- 
down  time  that  can  bedangerousduring  termi¬ 
nal  operations. 

•  Some  flight  crews  only  use  checklists  when  it 
dees  not  slow  down  other  aircraft  operations. 

•  Regardless  of  time  available,  some  crews  do 
not  use  checklists  during  some  operations  for 
which  lists  arc  provided. 

•  The  print  on  some  checklists  is  difficult  to 
read  under  poor  lighting. 

•  Responsibility  of  individual  crewmembers 
concerning  checklist  use  is  not  always  clear  or 
well  defined. 

•  The  types  of  items  included  on  checklists  vary 
among  carriers. 

•  Some  inflight  events  are  considered  emergen¬ 
cies  by  some  carriers  but  not  by  others. 

•  Emergency  checklists  and  handbooks  arc  not 
always  quickly  accessible  to  the  flight  crew. 

•  It  is  difficult  to  quickly  locate  emergency 
procedures  in  some  checklists  and  handbooks. 

•  Procedures  indicated  on  some  cliecklists  are 
inconsistent  with  those  described  in  the  com¬ 
panion  flight  manual. 


•  Some  checklists  do  not  include  procedures  for 
all  common  emergencies. 

•  In  some  cases,  the  size  and  formatting  of 
emergency  checklists  makes  them  more  diffi¬ 
cult  to  read  than  normal  checklists. 

4J  RECOMMENDATIONS 

We  did  not  collect  sufficient  data  to  determine  if 
poor  checklist  design  and  poor  habits  in  the  use  of 
checklists  were  widespread  throughout  the  indus¬ 
try.  However,  our  data  do  support  the  conclusion 
that  there  are  Parts  135  and  121  carriers  who  are 
operating  with  poorly  designed  checklists  and  manu¬ 
als,  and  who  have  flight  crews  who  are  not  well 
trained  in  the  use  of  these  aids  and  who  admit  to  not 
using  them  when  they  are  expected  to. 

Accordingly,  we  make  the  following  recommenda¬ 
tions  regarding  the  design  and  use  of  checklist  and 
manuals.  We  also  recommend  supporting  research 
and  development  activities. 

4.2.1  Checklists 

•  “Normal"  Checklists  should  be  short  and  easy 
to  use.  They: 

-  Should  include  only  those  items  that  are 
pertinent  to  the  safety  and  control  of  the 
aircraft 

-  Should  he  listed  in  an  order  that  mini¬ 
mizes  heads-down  time  and  the  attention 
of  more  than  one  crewmember  at  a  time. 

-  Sublists,  e.g.,  “BEFORE  TAXI”  check¬ 
list  and  “AFTER  TAKEOFF’  checklist, 
should  appear  on  the  checklist  card  in  the 
order  in  which  they  will  be  used. 

-  Should  have  selected  safety  critical  items 
such  as  gear  and  flaps  as  final  items  on 
“BEFORE  TAKEOFF’  and  “BEFORE 
LANDING”  checklists,  even  if  this  re¬ 
peats  an  earlier  i.'em  in  the  checklist  This 
will  facilitate  quick  and  last-minute  refer¬ 
ence  to  these  items. 

-  Should  have  alphanumerics  of  sufficient 
size,  clarity  of  print,  and  contrast  to  be 
easily  read  under  any  illumination  condi¬ 
tions  likely  to  be  encountered  in  the  cock- 


25 


pit  In  the  absence  of  cockpit  research 
dealing  specifically  with  this  issue,  we 
recommend,  in  “Guidelines"  (Appendix 
A)  that  the  checklist  body  be  10-point 
type,  boldface,  all  caps,  and  that  the  check¬ 
list  title  be  12-point  type,  boldface,  all 
caps. 

-  To  the  greatest  degree  possible,  should 
have  no  greater  number  of  items  than  can 
be  presented  on  a  single  checklist  card  and 
can  be  easily  read  and  stowed  in  a  readily 
accessible  place  in  the  cockpit 

•  “Emergency”  checklists  should  be  quick  to 
access  and  easy  to  use  under  stressful  condi¬ 
tions,  They: 

•  Should  be  quickly  accessible  in  the  cock¬ 
pit  by  both  the  Captain  and  First  Officer. 

-  Should  be  available  on  a  card  (on  the 
reverse  of  the  “Nomtal”  checklist  card  if 
possible)  as  well  as  in  the  manual. 

-  Should  be  in  a  standard  format  The  order 
in  which  the  emergencies  arc  presented 
on  the  card  should  be  standardized.  This 
should  cover  all  aircraft  types  in  a 
company’s  fleet  and  should  take  a  form 
such  as  all  engine  problems  first  or  all 
fires  first  etc.,  (to  be  decided  by  each 
company).  In  this  manner,  a  crew  flying 
for  a  particular  company  will  know  where 
to  look  for  individual  checklists  regard¬ 
less  of  what  aircraft  they  are  flying.  In 
addition,  the  order  in  which  the  proce¬ 
dures  are  presented  fer  each  emergency 
should  be  standardized  to  the  greatest 
degree  practical,  particularly  within  type. 

-  Should  have  a  clearly  defined  start  and 
finish  with  a  title  set  off  by  type  two  sizes 
larger  than  that  of  the  text,  boldfaced,  and 
all  caps.  Each  list  of  procedures  should  be 
clearly  separated  from  other  lists.  This 
should  facilitate  quick  identification  un¬ 
der  conditions  of  stress  and  low  illumina¬ 
tion. 

-  Should  be  composed  of  type  no  smaller 
than  that  of  well-designed  “Normal” 
checklists,  and  if  space  permits,  larger. 
“Emergency”  checklists  are  often  used 


undercircumstancesof environmental  and 
psychological  stress,  and  consequently 
should  be  as  readable  as  possible. 

-  Should  be  easy  to  understand  and  execute. 
Each  “Emergency”  checklist  should  be 
composed  of  only  those  items  needed  to 
combat  the  emergency.  They  should  be 
listed  in  the  order  in  which  they  are  to  be 
performed.  They  should  he  stated  in  com¬ 
mon  terminology,  in  a  positive  manner, 
and  in  as  few  words  as  can  be  used  to 
convey  the  actioa 

Subsequent  procedures  which  must  be 
performed  as  a  result  of  the  emergency 
procedure,  (e.g„  “SINGLE  GENERA¬ 
TOR”  procedure  after  a  generator  loss 
due  to  shutting  down  an  engine  as  a  result 
of  an  engine  fire),  should  be  covered  in  the 
expanded  checklists  in  the  manual. 

4 22  Manuals 

•  Procedures  for  checklist  use: 

-  Should  be  dearly  defined  in  the  manual. 
This  should  include  dear  direction  as  to 
which  flight  officer  reads  what  challenges 
and  which  responds,  and  should  specify 
this  for  each  phase  of  operation;  i.e.,  air¬ 
plane  stationary,  airplane  taxiing,  airplane 
in  the  air. 

-  Should  require  quantitative  or 
differentiating  responses  forall  appropriate 
checklist  challenges.  Whenever  possible, 
responses  should  specify  position  or 
quantity;  e.g.,  FLAPS. ...20, 
FUEL.....48.000#,  etc.  The  answer  “AS 
REQUIRED"  should  not  be  allowed. 

-  Should  limit  dual  response  items  to  the 
highest  priority  safety  critical  items. 

-  Should  require  that  checklists  worn  to  the 
point  of  reduced  readability  be  immedi¬ 
ately  replaced.  No  Minimum  Equipment 
List  (MEL)  delay  should  be  allowed  on 
this  item. 

•  Format  requirements: 

-  Should  specify  a  standardized  table  of 
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contents,  including  dear  reference  to  the 
checklist  sections. 

-  Should  indude  tabbed  dividers  for  sec¬ 
tions  that  may  have  to  be  accessed  quickly. 
For  checklists,  these  should  include  stan¬ 
dardized.  color-coded  tabs,  by  section 
("Normal,"  “Abnormal,"  and  “Emer¬ 
gency”)  and  appropriately  labeled  tabs 
within  each  section.  Each  section  should 
begin  afterthe  tab  with  the  first  page  being 
a  dear,  alphabetized  index. 

4X3  Checklist  Training 

The  required  training  curriculum  for  each  airline 

should  incorporate  checklist  training,  including: 

•  Proper  use  of  checklists. 

•  Crew  coordination  in  the  use  of  checklists. 

•  The  necessity  for  compliance  with  checklists. 
4X4  Review  of  FARs 

This  review  should  be  conducted  to  determine  the 
need  fon 

«  A  clear  definition  of  “NORMAL," 
“ABNORMAL.”  and  “EMERGENCY.”  If 
not  accomplished  by  FAR  change,  this  should 
be  specified  in  an  Advisory  Circular.  This  will 
standardize  the  use  of  these  terms  for  both 
manufacturers  and  airlines,  and  should  provide 
the  means  to  design  “Emergency"  checklists 
which  arc  similar  in  length  and  content  At 
present  some  manufacturers  include  in  their 
“Emergency”  checklists  many  checklists  that 
would  be  considered  “Abnormal”  by  others. 
This  has  resulted  in  some  “Emergency” 
checklists  of  excessive  length. 

•  A  rewrite  of  the  FARs,  or  an  Advisory  Circu¬ 
lar,  to  indicate  that  manuals  and  checklists  for 
Part  121  and  Part  135  operators  have  essen¬ 
tially  the  same,  well-defined  basic  require¬ 
ments.  This  should  include  all  stages  from 
initial  approval  to  operator  requested  changes. 
Those  parts  not  required  by  the  scope  o  f  opera¬ 
tion  of  smaller  Fart  135  carriers  could  be 
eliminated. 

4X5  Research  and  Development 

Research  and  development  should  be  conducted  to: 


•  Establish  quantitative  and  behavioral  criteria 
for  checklist  accessibility  and  readability. 

•  Develop  a  prototype  checklist  for  use  by  safety 
inspectors  for  evaluating  air  carrier  checklists 
and  flight  manuals. 


•  Develop  and  evaluate  the  usefulness  of  a  stan¬ 
dard  format  organization,  and  table  of  con¬ 
tents  for  aircraft  flight  manuals. 

•  Evaluate  the  use  of  all  caps  vs.  mixed  case 
lettering  in  checklist  design. 

•  Develop  and  evaluate  the  use  of  a  standard 
terminology  forcontrols,displays.  and  inflight 
operations  in  checklists  and  flight  manuals. 

•  Evaluate  the  utility,  safety  benefits,  and  limits 
of  audio  checklists,  checklists  on  CRTs,  and 
checklists  with  artificial  intelligence  features, 
both  in  a  laboratory  setting  and  in  an  opera¬ 
tional  context  (There  is  currently  an  audio 
checklist  design  available  from  Heads-Up 
Technology  that  will  be  the  subject  of  a  study 
by  a  major  airline.) 

•  Evaluate  the  benefits  of  color  coding  and 
different  font  styles  on  checklist  readability 
for  electronic  as  well  as  paper  checklists. 

•  Evaluate  the  operational  feasibility  of  safety 
critical  cliecklist  item  interlocks  that  would 
prevent  aircraft  takeoff  without  completion  of 
safety  critical  items. 

•  Evaluate  the  utility,  safety  benefits,  and  limits 
of  mechanical  checklists  such  as  those  used  by 
a  major  airline  for  “BEFORE  TAKEOFF’ 
and  “BEFORE  LANDING.” 

•  Develop  and  evaluate  a  prototype  checklist  for 
Parts  135  and  121  use.  This  list  would  be 
developed  as  an  example  of  how  human  fac¬ 
tors  principles  in  the  use  of  formatting,  font 
size,  and  color  coding  can  be  applied  to  check¬ 
list  design. 

•  Determine  the  influence  of  memory  items  on 
emergency  checklists  on  the  speed  and  accu¬ 
racy  with  which  emergency  procedures  arc 
performed. 
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CHECKLIST  GUIDELINES 


The  need  for  a  set  of  standards  to  guide  manufactur¬ 
ers  and  airlines  in  developing  manuals  and  check¬ 
lists  is  becoming  more  and  more  apparent.  Any 
proposed  guidelines  would  have  to  encompass  a 
number  of  areas,  such  as  print  size  and  style,  format, 
color  coding,  overall  color  use,  brevity,  clarity,  etc. 
Another  area  of  concern  is  readability  under  all 
conditions  of  cockpit  lighting,  from  bright  sunlight 
cruising  at  altitude  to  night  flight  with  low  ambient 
cockpit  lighting.  Although  supplementary  lighting 
would  normally  be  used  in  the  latter  case,  too  much 
white  light  will  temporarily  destroy  night  vision. 

Bearing  these  points  in  mind,  the  following  set  of 
guidelines  are  proposed  as  the  first  step  in  the  final 
development  of  a  set  of  standards  for  industry  use. 

PRINT  SIZE  AND  STYLE 
Figure  A^l  shows  two  extremes  of  print  size  and 
style.  The  first  is  a  copy  of  the  actual  checklist  on  a 
Jetstream  3 1  involved  in  an  accident  in  New  Orleans 
in  1987.  It  is  representative  of  the  size  and  style  of 
print  used  in  the  checklists  of  some  smaller  carriers 
and  is  clearly  too  small  (0.075")  and  tightly  spaced 
for  adequate  legibility  under  the  range  of  lighting 
conditions  which  an  aircrew  will  normally  encoun¬ 
ter.  Figure  A-2  is  a  copy  of  the  actual  checklist  on  an 
MD-80  that  was  involved  in  an  accident  in  Detroit  in 
1987.  The  print  is  the  same  size  as  that  of  the 
Jetstream  31  checklist,  and  although  it  is  formatted 
better,  we  still  find  it  too  small  for  easy  readability 
in  all  lighting  conditions.  The  second  example  in 
Figure  A- 1  demonstrates  the  recommendation  made 
in  the  Human  Engineering  Guide  to  Equipment 
Design,  for  use  if  any  lighting  conditions  less  than 
one-foot  candle  can  be  expected.  Although  highly 
legible,  the  letters  are  too  large  (0.20")  for  practical 
use. 

What  we  recommend  is  between  the  extremes  cited 
above  and  finds  its  basis  in  MIL  SPEC  recommen¬ 
dations  and  current  applications  by  a  number  of 
major  airlines.  An  example  is  shown  in  the  DC-9 
checklist  in  Figure  A-3.  In  that  example,  the  print 
sizeisO.  15"  (14  point)  for  the  primary  heading  (DC- 
9  NORMAL...);  0.125”  (12  point)  for  the  checklist 
names  (i.e.,  BEFORE  STARTING  ENGINES);  and 
0.1"  (10  point)  for  the  checklist  text  It  is  also  done 
in  all  caps,  boldface  type,  with  the  exception  of  the 
notes,  which  are  in  initial  caps  with  lowercase 
following.  MIL-C-81222C  and  MIL-C-38778A 
specify  the  use  of  14-point  (0. 15")  type  for  checklist 
headings,  and  the  use  of  12-point  (0.125")  type  for 


the  body  of  the  checklist.  Both  of  these  arc  slightly 
larger  than  that  used  in  the  DC-9  checklist  and 
appear  to  represent  a  good  compromise  between 
legibility  and  practicality. 

From  the  practical  standpoint,  the  use  of  12-point 
type  (0.125")  throughout  the  text  of  a  document 
results  in  54  lines  of  type,  with  1”  margins  top  and 
bottom,  on  an  8  1/2"  x  1 1"  page  (i.e.,  the  size  used  in 
this  report).  The  size  shown  in  example  two  of 
Figure  1  (0.2")  results  in  29  lines  on  an  8  1/2"  x  1 1" 
page  with  less  than  1 "  margins  top  and  bottom.  Since 
many  checklists  contain  more  than  29  items,  this 
would  result  in  an  increase  in  the  number  of  pages 
required  to  accomplish  a  checklist.  We  feel  that 
normal  checklists  should  be  kept  to  no  more  than 
one  8  1/2"  x  1 1"  page  —  either  laminated  or  trifold 
—  if  a  card  checklist  is  to  be  used.  The  reasons  for 
that  are  as  follows; 

a.  Many  pilots  clip  the  checklists  to  the  yoke  or 
parts  of  the  window  apparatus  for  use.  This  is 
easy  with  one  page  —  more  than  one  page 
becomes  too  bulky. 

b.  Having  to  flip  through  more  than  one  page  to 
read  normal  checklists  in  a  multiple  leg  day  is 
cumbersome. 

c.  A  checklist  of  one  page  can  be  found  more 
easily  and  quickly. 

d.  A  single-page  checklist  is  easier  to  stow  and 
retrieve  when  needed. 

e.  We  feel  that  anything  that  promotes  ease  of  use 
with  a  checklist  will  discourage  misuse,  or 
neglect,  of  checklists. 

Based  on  the  above,  our  recommendations  for  print 
size  and  style  are  as  follows: 

1.  CHECKLIST  HEADINGS  —  12-point 
(0. 1 25")  type,  all  caps,  boldface,  in  a  typeface 
equivalent  to  those  recommended  in  the  MIL 
SPECS.  These  should  be  black  type  on  a  white 
background,  or  white  lettering  on  a  dark  back¬ 
ground.  The  latteris  recommended  in  MIL-C- 
1472C,  in  “Human  Engineering  Guide  to 
Equipment  Design,”  and  is  currently  in  use  by 
Flight  Safety  Canada,  Ltd.  in  their  Canadair 
checklists.  FlightSafety  variesthc  background 
according  to  the  type  of  checklist:  white  for 
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FIGURE  A-l.  EXTREMES  OF  PRINT  SIZE  AND  STYLE 


REFORE  TAKEOFF  (FINAL  I  TOG) 

— TTTHiOTraTrTiirTTl 

2.  Filet  tort  -  ON 

3.  Transponder  -  ON 

4.  011  Cooler  Flops  -  CLOSED /TOTS  NORMAL 

5.  limits  -  AS  REQUIRED 

CJK.  let  Frotocttor  -  AS  REQUIRED 

CR7.  FI oh  Selectors  •  OFF 

CRB.  Speed  levers  -  1003  Ml  CLEANED 


BEFORE  TAKEOFF  (FINAL  ITEMS) 

— i:  'Hind shield  Heat  “1* 

2.  Filet  tort  -  ON 

3.  Transponder  •  ON 

4.  011  Cooler  Flops  -  CLOSED/TOTS  NORMAL 

5.  Lights  -  AS  REQUIRED 

CRB.  Ice  Protection  •  AS  REQUIRED 

CR7.  Floe  Selectors  *  OFF 

CRB.  Speed  levers  -  1001  Ml  CLEARED 
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normal,  yellow  for  abnormal,  and  red  for 
emergency.  In  the  interests  of  economy,  the 
users  may  wish  to  stay  with  black,  lettering  on 
a  white  background,  however,  the  white  on  a 
dark  background  we  have  found  to  be  easily 
tead  under  all  light  conditions  and  we  recom¬ 
mend  it. 

2.  CHECKLIST  TEXT  —  10-point  (0. 1 ")  type, 
all  caps,  boldface,  in  a  typeface  equivalent  to 
those  recommended  in  the  MIL  SPECS.  This 
should  be  black  lettering  on  a  white  back¬ 
ground. 

3.  NOTES  —  10-point  (0.1")  type,  initial  caps, 
lowercase  following,  in  a  typeface  equivalent 
to  those  recommended  in  the  MIL  SPECS. 
This  should  be  black  lettering  on  a  white 
background. 

If  space  and  economy  permit,  we  recommend  mov¬ 
ing  up  to  14-point  type  (0.15")  for  checklist  head¬ 
ings  and  12-  point  type  (0.125")  for  checklist  text 
and  notes.  Flight  Safety  has  done  this  in  their  Canadair 
checklists  and  it  produces  superior  readability. 

FORMAT 

We  recommend  a  format  of  challenge  and  response 
— consisting  of  the  query  to  the  left  margin,  fol¬ 
lowed  by  a  dotted  separation,  followed  by  the  re¬ 
quired  response  (to  be  right  justified).  This  is  the 
specified  format  in  MIL-C-81222C,  is  quite  com¬ 
mon  in  industry  use,  and  is  illustrated  in  Figures  A- 
2  and  A-3. 

COLOR  CODING 

Throughout  the  industry  the  use  of  color-coded 
annunciator  lights  is  standard  —  red  indicates 
“WARNING"  or  danger,  yellow  indicates  “CAU¬ 
TION,”  green  indicates  safety.  Flight  Safety  Canada, 
Ltd.  and  some  air  carriers  have  carried  this  color 
coding  through  in  checklist  use.  “Abnormal”  check¬ 
lists  are  identified  by  headings  of  yellow,  and  “Emer¬ 
gency”  checklists  by  headings  of  red,  with  the 
“IMMEDIATE  ACTION”  items  boxed  in  red. 

We  recognize  that  to  do  this  is  more  costly,  but  we 
recommend  it  strongly.  Color  coding  such  as  the 
above  lends  itself  to  ready  identification,  and  hence 
ease  of  use. 

OVERALL  COLOR  USE 
The  MIL  SPECS  previously  quoted  specify  the  use 
of  black  type  on  white  paper,  with  the  exception  of 
the  checklist  headings  recommended  to  be  white 


print  on  a  dark  background.  However,  a  limited 
study  done  by  the  head  of  the  Publication  Depart¬ 
ment  of  a  regional  carrier,  in  conjunction  with  an 
optometrist,  indicates  that  better  readability  is  at¬ 
tained  under  normal  variations  of  ambient  cockpit 
lighting  by  the  use  of  black  type  on  a  bright  lemon 
yellow  background.  This  would  appear  to  be  borne 
out  somewhat  by  the  study  done  a  number  of  years 
ago  by  big  city  fire  departments  which  led  to  new 
equipment  being  delivered  with  bright  yellow  paint. 
They  found  that  the  equipment  was  more  visible  to 
other  drivers  with  that  paint  scheme  than  with  the 
standard  fire-engine  red.  Once  again,  economics 
entered  the  picture,  and  most  fire  equipment  is  still 
red. 

We  have  seen  the  results  of  the  regional  carrier  study 
and  agree  that  it  promotes  better  readability  under  a 
variety  of  ambient  cockpit  lighting  conditions. 

BREVITY  AND  CLARITY 
The  following  is  a  quote  from  MIL-C-81222C: 
“...procedures  shall  be  presented  in  checklist  form, 
abbreviated  from  the  amplified  checklist  or  proce¬ 
dures  in  the  NATOPS  Flight  Manual.  This  abbrevia¬ 
tion  is  to  be  accomplished  by  omitting  explanatory 
material  and  reducing  the  check  item  to  the  mini¬ 
mum  necessary  to  describe  the  required  action.  For 
example,  the  step  ‘Reduce  airspeed  to  130  knots 
IAS  for  best  glide’  can  be  abbreviated  ‘Airspeed  - 
130  K1AS  Glide’.”  MIL-C-27278B  says:  “The 
procedures  of  the  checklist  shall  be  derived  by 
abbreviating  the  procedures  and  eliminating  the 
amplifications  of  the  procedures  in  the  procedure 
sections  of  the  parent  manual...” 

As  indicated  by  the  above,  no  ambiguity  or  excess 
verbiage  should  be  allowed  in  checklists.  The  re¬ 
quired  items  and  no  more  should  be  covered.  One 
checklist  studied  had  1 39  items  on  the  “AIRPLANE 
ACCEPTANCE” checklist  This  is  excessive.  These 
items  should  be  checked  on  a  defined  preflight  but 
to  cover  every  item  on  a  preflight  in  a  checklist  is  to 
court  checklist  neglect  by  crews. 

LEXICON 

Standardized  terminology,  consisting  of  common 
aeronautical  terms,  should  be  used  in  all  cases.  MIL- 
M-770QC  says:  “Standard  terminology.  In  most 
cases,  use  the  terminology  for  equipment  that  is 
consistent  with  the  intended  operator’s  standard 
usage  and  is  preferable  to  some  of  the  more  techni¬ 
cally  descriptive  nomenclature  [sic].  Some  examples 
are:  'throttle’  vs.  'power  control  lever’,  'circuit 
breaker’  vs.  'fault  circuit  detector’...” 
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FIGURE  A-2.  MD-80  CHECKUST 


KFQMt  STMT 

—mi  . . SIT 


cum  rniMi  aamouii . «mt 

MX  mhuulic  n*»  k  rauMxi  .  ‘•‘M 

CIBCUIT  . .  •*«* 

wnuis . acs 

UDIC*.  kLTUXTUl  ft  rUOT  ■■■  ....  "CD  4  SIT 

nu  ion .  **«ju*ktitiu)  4  am 

. .  <* 

MAT  MU  SIM . <■* 

. . ON 

Ana  stmt 

. .  “S 

ICMITICM  . •ort 

tucTiic  raws . . 

AN  All .  •<«  «M> 

aii  caMiTiMiia  mu  amaxA . •um 

MUUT1C  I-IUI .  *0W  CLOUD 

TiMxru  rwr  ft  muuuc  rrtnm  ....  wicn 


IASI 

run .  *.(sirriM6) 

TRIM .  “(MTTIMC) 

IPS  4  IIISKU  4UCS  .  M(UTTINCS) 

im  .  (as  UQ) 

FLICMT  iNttlUCMTS  .  **(MOC)  A  SLAVING 

CONTROLS  A  CUVATOC  FWU  .  "CKD-TOP 

_ CKO-SOTTGW 

OC LAVED  ENGINE  STMT 

HAIill  A  IGNITION .  (AS  HQ)  A  ON 

DELAYER  ASTER  STAJTT 

AJMMCIATOB  .  CKD 

IGNITION . •OFT 

rucnic  NVU .  *Z¥h 

AFU  Alt  .  •OFF 

Alt  CM  IT  ION  INC  SUPPLY  SWITCHES  . . .  *AJTO 


ENGINE  ANTI-ICE  A  Nil  BEAT .  (AS  IEQ) 

PNEUHATIC  X- FEEDS .  •CLOSED 

AFU .  *( AS  BSD) 

KFORE  TAKEOFF 

FLIGHT  ATTENDANT .  •MOTlFItD 

TtAMSPOCCt .  *0N 

AMAMCIATOf  .  CXD 

IGNITION .  ON 

a  IM 

NO  SMOKE  SIGN .  *<AS  ACQ) 

IGNITION  .  *( AS  BU)> 

FUEL  FUIPS  .  *(AS  BED) 

CABIN  IfiiSStBI  CGWTROLLEt  .  *CKD 

•YNC  . •ON 

HYDRAULIC  FttIFS  .  «OFT  A  LOW 

FLAP  TAOOrr  SELECTOR . •STOWED 

IIHUMG£ 

ALTIISTEU . ••(SETTING)  4  X-CED 

EPt .  •(CA) 

AltS FEED  BUG  . ••(SETTING) 

SEAT  BELT  SIGN  .  MM 

CABIN  PRESSURE  CONTRO LUX  .  *CKD 

hydraulic  pumps . *m  a  nigh 


MD-80  j 


NO  SMOKE  SIGN 

IGNITION . 

FUEL  SYSTEM  -  - 

SYNC . 

GLAD  . 

SPOILERS . 

AUTO  MAXES  . . 


tCFQRC  UbOING 

1 


.  *SET  FOR  M 

!!!!!.’!!!!!!!!!!!!!!.  •tmee* 

. . . . . < 

. *•*  <AI 


FLAPS 


•(SETT 


AFTER  LANDING 

SPOILED! . 

FUPS . •(AJ 

ICS  PROTECTION . 

IGNITION . 

AFU . *(A1 

PNEUHATIC  X-FUD  .  MB* 

■ADM  4  TRANSPONDER .  •OFF  A  SI 

AFU  AIR  A  ELECTRIC  POWER . MAS  RED) 

PARKING 

All  COMIITIONINO  MKT  SWITCHES  . .  .  •OFT  « 


PNEUMATIC  X'FEESS . 

FUEL  CONTROLS  . 

SEAT  BELT  SIGN . 

StACON  . 

CROCES  A  MAOS .  (Afl 

AUX  A  TRANSFER  SUMPS . 

FUEL  PUMPS  .  •(Al 

WINDSHIELD  NEAT .  *(Al 

LOGBOOK  ENTRY .  (mi 


TERMINATING 

EMERGENCY  LIGHTS . 

riTGT  MAT  . 

Alt  OM31TI0NING  PANEL . •{AS 

RADIOS  A  GALLEY  POWER . 

SECURING  AJRPLAM  AT  NON  MIA  STATIONS 

APU . 

OUTFLOW  CONTROL . f .  «(A fl 

SATTERT  SWITCH . . . 


A-5 


m  an  iiiiiisdi  ihmt  Hindu 


Included  in  this  standaid  terminology  should  be  a 
dictionary  of  abbreviations  to  be  used  whenever 
abbreviations  are  needed.  To  quote  MIL-M-7700C: 
“The  glossary  of  each  manual  shall  contain  a  list  of 
the  abbreviations  used  in  the  manual,  except  for 
normally  accepted  and  understood  abbreviations 
such  as  ac,  dc,  and  rpm,”  Although  the  MIL  SPEC 
mentions  “manual”  specifically,  the  same  would 
apply  to  checklists,  since  they  derive  from  the  flight 
manuals.  In  MIL-M-7700C  there  is  a  list  of  ap¬ 
proved  abbreviations,  and  MIL-STD-12D  is  dedi¬ 
cated  to  abbreviations.  Some  of  them  are  different 
from  those  used  in  civilian  aviation,  but  a  lexicon  for 
standardization  would  resolve  these  differences  and 
create  a  set  of  abbreviations,  with  a  basis  in  the  MIL 
SPECS,  for  industry  use. 

We  feel  that  in  the  interest  of  standardization,  and  to 
ease  crew  transition  from  one  aircraft  type  to  an¬ 
other,  a  lexicon  of  common  terms  and  abbreviations 
must  be  developed. 

CLARIFICATION  OF  “NORMAL,”  “ABNOR¬ 
MAL,”  AND  “EMERGENCY” 

There  must  be  clear  definitions  of  what  are  to  be 
regarded  as  “NORMAL,”  "ABNORMAL,”  and 
“EMERGENCY.”  The  manufacturer  of  one  im¬ 
ported  aircraft  flown  by  the  regional  airlines  in¬ 
cludes  39  “EMERGENCY”  checklists  out  of  a  total 
of  82  checklists.  An  example  of  one  checklist  clas¬ 
sified  improperly  as  an  “EMERGENCY,”  in  our 
opinion,  is  “UNPRESSURIZED  FLIGHT.” 

One  set  of  definitions  of  “ABNORMAL”  and 
“EMERGENCY”  has  been  created  by  Flight  Safety 
Canada,  Ltd. 

“EMERGENCY  PROCEDURES”— “This 
section  deals  with  foreseeable  but  unusual 
situations  in  which  immediate  and  precise 
action  may  be  required  by  the  crew.” 

“ABNORMAL  PROCEDURES”— “Proce¬ 
dures  in  this  section  address  foreseeable  situ¬ 
ations  involving  failures,  in  which  the  system ’s 
redundancy  or  selection  of  an  alternate  system 
will  maintain  an  acceptable  level  of  airworthi¬ 
ness.” 

InMIL-M-7700C  there  are  definitions  for  “WARN¬ 
INGS”  and  “CAUTIONS”  which  could  be  bor¬ 
rowed  for  “ABNORMALS”  and  “EMERGEN¬ 
CIES.” 

“WARNING” — '  ‘Operating  procedures ,  tech¬ 


niques,  etc.,  which  could  result  in  personal 
injury  or  loss  of  life  if  not  carefully  followed.” 

“CAUTION” — “Operating  procedures,  tech¬ 
niques,  etc.,  which  could  result  in  damage  to 
equipment  if  not  carefully  fallowed.”  To  the 
latter,  we  would  add,  “am  if  not  carefully 
followed,  could  eventually  lead  to  personal 
injury  or  loss  of  life.” 

The  Flight  Safety  definitions  are  not  as  strongly 
worded  as  the  ones  in  the  MIL  SPEC,  but  do  convey 
the  sense  of  urgency,  nonetheless.  A  combination  of 
these  definitions  would  satisfy  the  need  to  provide 
strict  guidelines  for  use  by  aircraft  manufacturers 
and  airlines  in  the  preparation  of  aircraft  flight 
manuals  and  checklists. 

MANAGEABILITY  OF  CHECKLISTS 
Paper  checklists  should  be  of  an  easily  used  and 
stowed  size.  We  recommend  in  “PRINT  SIZE  and 
STYLE”  that  card  checklists  be  8  1/2"  x  1 1 ,”  either 
laminated  or  trifold.  We  also  recommend,  if  pos¬ 
sible  in  keeping  with  the  recommendations  on  print 
size  and  style,  that  there  be  a  combination  on  one 
card  of  “Normal”  and  “Emergency”  checklists.  One 
group  on  one  side  of  the  card,  one  on  the  other.  One 
airline  uses  this  combination.  The  combinationmakes 
the  task  of  location  of  needed  checklists  far  easier. 
However,  in  this  case,  the  recommendations  for 
print  size  and  style  are  not  met. 

To  retain  the  recommended  size  of  print  we  recom¬ 
mend  that  there  be  two  cards,  one  for  “Normal” 
checklists,  and  one  for  “Emergency”  checklists  — 
color-coded  for  easy  identification.  These  should 
both  be  kept  in  the  same,  easily  accessible  place  in 
the  cockpit.  These  two  groups  of  checklists  are  the 
ones  that  should  allow  ready  access.  The  “Normal” 
checklists  are  used  all  the  time  in  daily  operation. 
“Emergency”  checklists  will  not  be  needed  on  a 
steady  basis,  but  should  be  immediately  available 
when  they  are  needed. 

It  is  normal  practice  with  many  airlines  to  keep 
“Abnormal”  checklists  in  the  flight  manual.  Since 
they  are  not  needed  on  an  immediate  basis,  this 
access  is  adequate. 

We  recognize  that  these  guidelines  do  not  address 
the  concern  of  the  proper  use  of  checklists  by  pilots. 
However,  we  feel  strongly  that  if  easily  usable, 
readable  checklists  are  available  to  pilots,  the  ten¬ 
dency  to  neglect  or  to  misuse  checklists  may  be 
reduced. 
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FIGURE  A-3.  DC-9  CHECKLIST 


DC-9  NORMAL  PROCEDURES  CHECKLIST 


BEFORE  STARTING  ENGINES 


TAXI 


LOG  BOOKS  AND  SEL . . . CHECKED 

RUDDER  PEDALS  AND 

SEATS . ADJUSTED  AND  LOCKED 

WINDOWS . CLOSED  AND  LOCKED 

02  PANELS/MASKS/INTERPHONE/ 

GOGGLES . SET  AND  CHECKED 

EMERGENCY  LIGHTS . ARMED 

PROBE  HEAT . CAPT 

WINDSHIELD  ANTI-ICE . ON 

ANTI-SKID . OFF 

PRESSURIZATION . AUTO  (UP)  AND  SET 

AIR  COND  SHUTOFF . AUTO 

FLIGHT  GUIDANCE  PANEL . SET  AND  CHECKED 

FLT  INSTR/SWITCHES/BUGS . SET  AND 

CROSSCHECKED 

FUEL  PANELOUANTITY  AND 

DISTRIBUTION . SET/ _ LBS  AND  CHECKED 

GEAR  HANDLE  AND 

LIGHTS . DOWN  AND  GREEN 

TRANSPONDER . SET 

STABILIZER  TRIM . SET 

SPOILER  LEVER . RET 

THROTTLES . CLOSED 

FUEL  LEVERS . OFF 

FLAPS/SLATS . UP/RETRACTED 

AILERON/RUDDER  TRIM . ZERO/ZERO 

PARKING  BRAKE/PRESSURE . PARKED/NORMAL 

SHOULDER  HARNESSES  (If  Operative) . ON 

FLIGHT  FORMS . CHECKED 

NO  SMOKING  SIGNS . ON 

SEAT  BELT  SIGNS  (5  Minutes  Prior  To  Departure) . ON 


PRIOR  TO  ENG  START  OR  PUSH-OUT 


GALLliY  POWER . OFF 

ENGINE  IGNITION . CONTTN 

FUEL  PUMPS . ON 

AUX  HYDRAULIC  PUMP . ON 

ANTi-COLLISION/EXTERIOR  LIGHTS . ON/AS  REQUIRED 

DOOR  ANNUNCIATORS . OUT 

AIR  CONDITIONING  SUPPLY  SWITCHES . OFF 


BEFORE  TAXI 

GALLEY  POWER . ON 

ENGINE  ANTI-ICE . AS  REQUIRED 

HYDRAULIC  PUMPS . CHECKED  AND  HI/ON 

APU . AS  REQUIRED 

PNEU  X-FEEDS  (One  Engine  Taxi) . L  CLOSED/R  OPEN 

im 

AIR  CONDITIONING  SUPPLY  SWITCHES . AUTO 

ANTI-SKID  (After  Leaving  Ramp  Area) . ARM 

R  ENG  (One  Engine  Taxi) . SHUTDOWN 

FLIGHT  CONTROLS . CHECKED 

FGS . T/OMODE 


BEFORE  TAKE-OFF 

Use  Mechanical  Checklist 


AFTER  TAKE-OFF  -  CLIMB 


After  Airplane  Clean  Up  When  Workload  Permits. 


GEAR . UP  AND  NO  LIGHTS 

SPOILER  LEVER . DISARMED 

AUTO  BRAKES . OFF/DISARMED 

FLAPS  AND  SLATS . UP/NO  LIGHTS 

PRESSURIZATION  AND  AIR  COND . CHECKED 

1Q.0Q0R.MSL 

ENGINE  IGNITION . AS  REQUIRED 

FUEL  SYSTEM . CHECKED 

STERILE  COCKPIT . CABIN  CHIME 

ALTIMETERS . RESET  AND  CROSSCHECKED 

HYDRAULIC  PUMPS . LOW/OFF 


18.PQ0FLMSL 

EXTERIOR  LIGHTS . AS  REQUIRED 

ALTIMETERS . RESET  AND  CROSSCHECKED 

(Outside  Continental  U.S.,  Reset  At  The  Specified 
Transition  Altitude  Obtained  From  Charts  Or  ATC.) 
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Advantages  and  Disadvantages  of  Checklist  Types 
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Tyre,  of 

checklist 


Advantages 


Disadvantages 


Mixed  - 

paper-slide 

or 

paper-sw/lt 


Paper 


Laminated 

card 


CRT 


Scroll 


Checklist 

"booklet" 


1.  Positive  check  on  checklist  progress  for 
those  lists  on  the  mechanical  portion 

2.  The  lists  on  the  mechanical  device  can 
be  interrupted  without  losing  track  of 
progress 


1.  Easy  to  use  and  move  around  as  the 
checklists  are  done 

2.  Easy  to  stow 

3.  Inexpensive  to  reproduce 

4.  Inexpensive  to  update 


1.  Necessitates  the  use  of  two  sets  of  lists 

2.  Slide  or  switch/light  combination  takes  up 
cockpit  real  estate 


1.  Easy  to  mark  on  and  mess  up 

2.  Becomes  worn  easily 

3.  Easy  to  misplace  or  remove  from  the 
airplane 

4.  May  be  difficult  to  use  under  poor  lighting 
conditions 


1.  Tough  and  hard  to  destroy 

2.  Difficult  to  mark  on  and  mess  up 

3.  Fairly  easy  to  stow 

4.  Remains  legible  longer  than  paper 
checklists 


1.  More  expeusive  to  produce  than  paper  lists 

2.  Bulky  in  comparison  to  a  folded  paper 
checklist 


1.  Can’t  lose  checklists 

2.  Can  present  systems  schematics  in  the 
case  of  "Abnormal*  or  "Emergency" 
checklists 

3.  Color-coded  for  ease  of  use 

4.  No  stowage  problem 

1.  Permanent  fixture  -  can’t  get  lost 

2.  Promotes  "heads-up"  posture 

3.  Relatively  easy  to  make  changes  to 
checklists 

4.  Stows  out  of  the  way  on  the  glare  shield 

5.  Easy  to  mark  progress 

1.  Groups  all  checklists  together  -  including 
the  "Abnormal"  and  "Emergency" 
checklists 


1.  May  displace  another  display  such  as  radar 

2.  Requires  a  lot  of  “heads-down"  time 

3.  Takes  up  cockpit  real  estate 

4.  Can  be  cumbersome  to  find  a  list  or  go 
back  to  a  point  in  a  list 


1.  Can  be  hard  to  read  (size  of  print  and 
distance  from  the  viewer,  and  some  are  not 
lighted  at  night) 

2.  Difficult  to  go  back  to  a  prior  item  on  a 
checklist 


1 .  Can  be  bulky  on  aircraft  with  a  large 
number  of  lengthy  checklists 


2.  If  properly  tabbed,  makes  it  easy  to  find 
any  needed  checklist 
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APPENDIX  C 

Summaries  of  ASRS  Special  Requests  1403  and  1417 
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AIRCRAFT 

TYPE 

OCCURRENCE 

CAUSE 

1.  LRG 

No  nose  wheel  steering,  had  to  be 
towed  off  runway 

Use  of  emergency  and  normal  checklists  -  missed 
one  item  on  the  "descent"  checklist 

2.  SMA 

Gear  up  landing 

No  written  checklist  available  -  interruption  from 
pilot-passenger 

3.  SMT 

Unauthorized  entry  onto  runway 

Busy  finishing  checklists  and  misheard  "clearance 
on  request"  for  "cleared  on  course’ 

4.  MLG 

Unauthorized  runway  crossing 

Busy  running  checklists,  poor  crew  coordination 

5.  MLG 

Possible  traffic  conflict,  early  turn  to 
SID  heading 

Reading  checklist  instead  of  paying  attention  to 

SID,  poor  crew  coordination 

6.  LTT 

Aborted  takeoff 

Didn’t  turn  on  water  injection  system  for  takeoff, 
poorly  designed  checklist  item,  lack  of 
understanding  of  standard  procedures 

7.  LRG 

Departed  10,000  lbs.  light  on  fuel, 
returned  to  airport 

Busy  doing  checklists  and  no  one  verified  the 
proper  fuel  loading  -  lack  of  clear  procedures  for 
fuelers  to  use  and  crews  to  verify  proper  fueling 

8,  MLG 

Unable  to  pressurize  after  takeoff, 
emergency  declared 

Pack  switches  not  on,  checklist  item  not 
accomplished,  also  not  caught  by  the  F/O  on  the 
quick  check  prioi  to  declaring  an  emergency,  found 
subsequently 

9.  WUB 

Altitude  excursion  and  request  for 
immediate  tumaway  from  weather 
because  of  loss  of  F/O  altimeter, 
flight  instruments,  and  radar 

F/O  flying,  Capt.  and  S'O  doing  an  abnormal 
electric  1  checklist,  one  part  of  the  procedure 
knocked  off  the  F/O  instruments  and  radar  at  the 
time  they  were  to  penetrate  a  line  of  weather 

10.  WDB 

Deviation  from  assigned  SID,  started 
to  fly  the  wrong  SID 

Confusion  during  time  of  leading  checklists  prior 
to  takeoff  and  receiving  runway  and  SID 
assignment  changes  without  programming  in  the 
FMS 

11.  LRG 

Crossed  hold-short  line  but  didn't 
quite  have  a  runway  incursiou 

Too  busy  with  short  taxi  distance,  unfamiliarity 
with  taxi  route,  and  amount  of  checklist  to  be 
accomplished 

12.  MLG 

Abnormal  lights  on  takeoff,  engine 
fire  warning  after  takeoff,  crew 
continued  to  destination 

Engine  fire  bell  went  out  and  all  engine  indications 
normal,  had  been  prior  work  on  and  abnormal 
lights  for  bleed  air  problems,  did  "air  cond.  supply 
temp  hi"  checklist,  later  maintenance  found  a  1" 
hole  in  the  engine  due  to  starter  reengaging 

13.  MDT 

Altitude  overshoot  in  emergency 

Loss  of  pressurization,  emergency  descent,  trying 
to  control  cabin  altitude  and  do  emergency  and 
abnormal  checklists  and  get  clearance  from  center, 
"1,000  ft.  above"  didn’t  get  called 

14.  LTT 

Total  electrical  failure  with 
emergency  battery  activation,  spoilers 
were  deployed  and  would  not  retract, 
diverted  to  loi  -uuway  for  landing 

and  blew  mi-.'-  ..car  tires  on  landing 

Bad  freon  air-conditioner  installation  resulting  in 
power  loss,  used  emergency  procedures 
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15.  LRG 

16.  SMA 

17.  WDB 

18.  SMA 

19.  SMA 

20.  LRG 

21.  WDB 

22.  SMT 

23.  MLG 

24.  MLG 

25.  WDB 

26.  WDB 


OCCURRENCE 


Hydraulic  problem  after  takeoff, 
dumped  fuel,  declared  an  emergency 
and  returned  to  land 


Aircraft  lost  partial  power  on  takeoff, 
hit  powerline  and  nuule  gear-up 
landing  on  grass  area  of  airport 

Aborted  takeoff  due  to  engine 
disintegration  with  associated  fire 
warning 


Gear  retraction  during  takeoff  roll, 
aircraft  dropped  to  runway 


Gear  up  landing 


Runway  incursion  on  rollout  causing 
aborted  takeoff  by  a  MLG 


Pilot  not  flying  shut  down  both 
engines  in  improper  response  to  a 
warning  light,  aircraft  was  between 
1,200’  and  1,500’  AGL  after  take¬ 
off,  able  to  restart  engines  and 
continue 

Altitude  overshoot  on  departure 


Aircraft  returned  to  land,  nose  gear 
pin  installed 


Altitude  alert  activated  in  cruise, 
descent  begun  and  oxygen  masks 
used 

Landed  wrong  runway  from  an  ILS 
approach 


Unable  to  control  cabin  altitude, 
made  a  descent  to  control  it 


"A”  system  hydraulic  failure  on  takeoff,  subsequent 
multiple  abnormals  due  to  air  conditioning 
problems,  emergency  declared  with  return  to 
airport,  equipment  standing  by  and  tow  to  the  gate 

No  time  for  emergency  checklists,  cause  of  loss  of 
power  under  investigation 


Aborted,  performed  emergency  checklist,  checked 
by  fire  crew,  taxiing  to  gate  fire  crew  noticed 
further  engine  fire  which  they  extinguished,  taxied 
to  the  gate 

Failure  to  follow  proper  checklist,  instructor  giving 
dual  instruction  gave  pilot  improper  instructions 
regarding  a  short  field  takeoff  and  the  proper 
positioning  of  the  gear  handle 

Pilot  extended  flaps  on  final  instead  of  gear  and 
didn’t  use  a  checklist  to  assure  gear  down,  ignored 
warning  hom  assuming  it  was  a  stall  warning  near 
the  ground  and  of  no  consequence 

Called  for  after  landing  checklist  on  rollout, 
misunderstood  'hold  short*  instructions  which  had 
been  acknowledged  by  the  F/O,  started  across 
runway,  too  much  confusion 

No  use  of  checklist,  highly  experienced  Capt.  tried 
to  do  an  abnormal  procedure  without  reference  to 
the  checklist  and  without  coordinating  with  the  F/O 
who  was  flying 


PIC  flying,  check-pilot  in  the  right  seat  acting  as 
F/O  and  known  for  not  encouraging  checklist  use 
or  altitude  callouts,  aircraft  sometimes  flown  as  a 
single  pilot  operation,  poor  coordination  and  no 
clear  direction  from  the  PIC  as  to  procedure  to  be 
followed 

Nose  gear  pin  installed  during  tow  to  gate,  during 
checklist  the  crew  checked  for  gear  pins,  felt  two 
and  thought  it  was  three 

Crew  did  not  turn  on  the  pressurization  switches 
when  doing  the  checklist,  thought  they  had  but 
missed  them 

Crew  busy  changing  frequencies,  doing  checklists, 
etc. ,  aircraft  had  been  flown  fully  automated,  on 
crosscheck  with  raw  data  found  improper  ILS 
alignment,  automatic  go-around  mode  engaged, 
Capt.  called  for  correction  on  ILS,  took  over 
aircraft  and  landed  on  the  wrong  runway  in  poor 
visibility 

Found  air  conditioning  pack  switches  off,  the  rest 
of  the  checklist  had  been  performed  properly  but 
those  had  been  missed 
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27.  WDB 

28.  MLG 

29.  SMA 

30.  MLG 

31.  SMA 

32.  SMA 

33.  SMT 

34.  LRG 

35.  LRG 

36.  MLT 

37.  SMA 

38.  SMA 


Tnih«>*d  ■  go- around  at  500'  AOL 
because  of  gear  not  down 


Poorly  designed  and  potentially 
dangerous  checklist 


Aircraft  moved  forward  after  start 
and  hit  the  nearby  fuel  pump 


Go-around  due  to  GPWS  activation  at 
500’ 


Gear  up  landing 


Gear  up  landing 


Misuse  of  transponder  code 
misleading  center  controller  with 
possible  altitude  conflict 

Altitude  overshoot 


False  fire  warning,  causing  use  of 
emergency  procedures  and  evacuation 
of  aircraft  after  landing  with  minor 
injury  to  passenger 

Aircraft  made  inadvertent  slats 
extended  and  flaps  up 
T/O,  no  serious  consequences 


Aircraft  landed  gear  up 


Aircraft  landed  gear  up 


Crew  had  not  fully  configured  the  aircraft  for 
landing  by  extending  the  gear  and  final  flaps, 
missed  those  items  on  the  checklist  and  got  the 
GPWS  at  500' 

'Generic'  checklist  used  for  an  entire  fleet,  has  no 
logical  flow  pattern  and  requires  a  PA 
announcement  on  final  in  contravention  of  the  FAR 
sterile  cockpit  rule,  has  been  approved  by  the  POI 

Pilot  used  aircraft  checklist  which  called  for 
throttle  to  be  pulled  out  1/2*  on  start,  regardless  of 
whether  warm  or  not,  aircraft  parked  close  to  fuel 
pump,  unable  to  control 

Cockpit  confusion  due  to  monitoring  close  traffic 
on  parallel  approaches,  gear  handle  not  fully  in 
down  detent,  when  fully  in  detent  GPWS  continued 
to  sound,  turned  off  pax  02  instead  of  GPWS 
because  of  proximity  of  switches  in  nonstandard 
cockpit  configurations  of  the  same  model  aircraft 

Gear  was  not  down  and  locked  despite  the  use  of  a 
checklist,  pilot  also  did  not  utilize  his  normal 
GUMPS  check 

Used  checklist  but  missed  the  gear,  CFI  in  the 
aircraft  didn't  GUMP  the  aircraft,  but  owner 
claimed  to  have  done  that  twice 

Sloppy  use  of  the  checklist  in  entering  transponder 
code 


Poor  crew  coordination,  disregard  of  CRM  and 
proper  procedures  by  Capt.  (on  one  takeoff  the 
checklist  was  just  finished  about  10  kts.  prior  to 
Vr) 

After  checking,  there  was  no  apparent  fire,  crew 
had  used  emergency  checklist  and  fought  supposed 
fire,  declared  an  emergency  and  evacuated  the 
aircraft 

Flaps  had  been  programmed  when  checklists  were 
done,  flaps  raised  when  taxiing  in  proximity  of  a 
large  pile  of  dirt,  flaps  never  extended,  T/O 
warning  horn  not  programmed  to  sound  without 
flaps  since  flaps  retractcd-slats  extended  T/O  is  one 
configuration  for  that  aircraft 

Pilot  forgot  to  extend  gear,  didn't  use  normal 
checklist  procedure  with  a  GUMP  backup  due  to 
fatigue,  inop  circuit  breaker  for  gear  warning  horn 

Pilot  didn’t  do  GUMP  check,  inop  gear  born, 
distraction  in  the  pattern 


C-4 


CAUSE 


AIRCRAFT  OCCURRENCE 
TYPE 

39.  MLG  Aircraft  departed  on  wrong  runway 

40.  MLG  Incorrect  V  meeds  set  and  not  caught 

until  during  the  T/O  roll 

41.  LRG  Aborted  T/O  due  to  flaps  not  set 

42.  MLG  Altitude  overshoot  on  SID 

43.  MLG  Aircraft  took  off  with  gear  pin 

installed,  returned  to  land 

44.  SMT  Aircraft  landed  gear  up 

45.  LTT  Overweight  landing 

46.  SMA  Aircraft  landed  gear  up 

47.  LRG  Aborted  T/O,  flaps  not  set  for  takeoff 

48.  MLG  Engine  failure  and  separation  during 

climbout 

49.  SMT  Gear  not  down  for  landing,  minor 

damage  from  runway  contact  during 
a  successful  go-around 

50.  WDB  Aircraft  off  course  by  20  miles  or  so 

51.  SMT  Red  gear  warning  light  on  approach 


Unexpected  aircraft  change  with  subsequent  rushing 
and  half-done  job  of  checklists,  poor  crew 
coordination,  hearing  clearance  but  not  monitoring 
Capt.’s  taxiing,  Capt.  late  starting  second  engine 
after  single  engine  taxi  with  rushed  and  incomplete 
checklist  and  subsequent  confusion 

Operating  rushed,  late  at  night  and  fatigued  and 
gave  standard  checklist  response  rather  than 
thorough  check 

Had  read  checklists  and  responded  but  the  flaps 
weren’t  set,  disrupted  diurnal  rhythm  -  craw  had 
flown  late  sequences  all  month  and  this  trip  had  all 
early  checkins 

During  abnormal  start  procedure  premature  pulling 
of  external  electrical  power  caused  automatic  bug 
and  altitude  reminder  resets,  improper  bug  set  was 
caught  on  the  checklist,  altitude  reminder  was  not 

Gear  pin  flag  removed  and  stowed  in  cockpit  by 
contract  ground  personnel,  pin  still  remained 
installed,  crew  on  doing  checklist  counted  three  red 
flags  but  didn’t  check  to  make  sure  that  a  pin  was 
connected  to  each 

Crew  preoccupied  with  approach  to  unfamiliar 
airport,  didn’t  do  final  check,  gear  horn  sounded 
just  at  the  flair  with  power  reduction 

Crew  fatigued  and  rushed,  improper  fueling  not 
caught  prior  to  departure,  no  mention  of  fuel  load 
on  any  of  the  checklists 

Only  used  checklist  partially,  checklist  difficult  to 
read  at  night,  busy  monitoring  traffic  at  busy 
airport,  neither  pilot  nor  instructor  caught  the  error 

Fatigued  crew  with  other  distractions  neglected  to 
extend  flaps  and  didn’t  read  the  taxi  checklist 

Cause  unknown  at  present,  emergency  checklist 
performed,  emergency  declared,  landing  without 
further  incident 

Pilot  had  gear  down  early  in  the  approach,  raised  it 
because  of  windshear  encounter,  with  bad  weather 
and  other  distractions,  did  not  extend  gear  again, 
poor  instrument  scan,  lack  of  checklist  or  GUMP 
use 

Using  automated  systems  and  Omega,  both  FMS 
and  Omega  had  gross  errors,  both  systems 
previously  written  up  in  the  log  for  maintenance 
action 

Unable  to  extend  gear  normally,  used  emergency 
procedure  and  checklist 
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52.  MLCj 

53.  MDT 

54.  LRG 

55.  MDT 

56.  MLG 

57.  SMT 

58.  LIT 


Failure  to  shut  down  right  engine 
prior  to  leaving  aircraft 


Flaps  not  fully  retracted  after 
landing,  flaps  damaged  by  passenger 
bus  driving  under  the  wing  on  the 
ramp 


Aircraft  had  to  level  during  climb 
due  to  cabin  altitude  warning  hom  to 
allow  cabin  to  catch  up  and  to 
pressurize 

Engine  fire  with  return  to  departure 
point  and  emergency  declared 


Aircraft  left  with  less  than  required 
fuel,  no  serious  consequences 

Aircraft  landed  gear  up 

Aircraft  made  go-around  during  an 
ILS  approach,  anomalies  in 
instrument  readings 


Crew  claims  to  have  used  shutdown  checklist,  also 
went  to  belly  baggage  bin  before  leaving  and  didn't 
notice  engine  running 

High  demands  on  crew  by  ATC  on  rollout  to  clear 
the  runway  quickly,  during  after  landing  checklist 
the  F/O  was  interrupted  many  times  and  didn’t 
retract  flaps  fully,  SILENT  checklist  without  other 
crew  monitoring 

Too  short  a  time  period  during  taxi  to  accomplish 
all  items  satisfactorily,  including  checklist,  missed 
the  air  conditioning  pack  switches,  should  have 
delayed  to  accomplish  everything 

Used  engine  fire  emergency  checklist,  looked  for 
single  engine  landing  checklist  and  couldn’t  find, 
checklists  in  the  process  of  revision  with  conflicts 
between  some  lists,  FAA  aware  of  the  problems 
but  no  action  to  date 

Distracted  attention  in  the  cockpit  during  the 
reading  of  checklist 

No  checklist,  gear  warning  hom  did  not  operate 

Crew  fatigue,  missed  proper  settings  on  nav 
receivers,  no  items  on  checklist  to  cover  this 


59.  MDT 

60.  SMT 

61.  SMA 

62.  MLG 

63.  LTT 

64.  MLG 


Aircraft  departed  with  incorrect  fuel 
load,  had  to  divert  to  alternate  to  get 
fuel 


Aircraft  landed  gear  up 
Aircraft  landed  gear  up 


Complaint  of  passengers  smoking  in 
the  aisles  and  seatbelt  sign  off  prior 
to  completion  of  flight 

Inflight  engine  shutdown  due  to  loss 
of  oil  pressure  and  quantity, 
emergency  declared 


Altitude  excursion  on  final  approach 


Distraction  in  the  cockpit  at  the  time  the  checklist 
was  being  read,  holding  for  fuel  to  be  loaded,  rush 
to  nuke  schedule,  fuel  last  item  on  the  crew 
acceptance  checklist  and  not  on  any  other  checklist 
for  a  crosscheck 

No  checklist,  task  saturation  at  low  level,  gear 
handle  used  but  gear  didn’t  extend,  gear  warning 
hom  inop,  didn’t  confirm  gear  green  lights 

Pilot  monitoring  hot  air  balloons  and  other  traffic, 
sun  in  his  eyes,  lowered  flaps  instead  of  gear, 
didn’t  get  warning  hom  due  to  high  manifold 
pressure  because  of  ATC-requested  high  speed  on 
approach 

Crew  not  using  checklist  correctly  and  not 
monitoring  passenger  conduct 


Crew  had  a  low  oil  pressure  warning  and  ignored 
it  because  of  previous  transducer  failures  on  this 
aircraft  type,  low  oil  quantity  and  pressure  caused 
a  flame-out,  did  emergency  checklist 

Aircraft  stall  warnings  systems  activated,  crew 
followed  stall  procedures  including  lowering  the 
nose  to  pick  up  speed  for  configuration,  system  had 
failed,  aircraft  was  not  in  a  stall 


C-6 


AIRCRAFT 

TYPE 


CAUSE 


65.  MLG  Aircraft  aborted  T/O  due  to  high 
wind  noise  around  Capt.’s  window 


66.  LRG  Didn’t  make  required  log  book 
entries 


67.  MLG  Gear  doors  didn't  retract  on  raising 

the  gear,  damage  to  doors  on 
subsequent  landing 

68.  WDB  Aircraft  unable  to  pressurize, 

descended  with  special  handling 

69.  LRG  Emergency  descent  due  to  loss  of 

pressurization 

70.  SMA  Aircraft  landed  gear  up 


71.  MLG  Cabin  altitude  horn  sounded,  unable 

to  control  cabin  altitude,  emergency 
descent  with  altitude  overshoot 

72.  MDT  Aircraft  took  off  with  cockpit  door 

open  and  flight  attendant  still  stowing 
baggage 

73.  LIT  Aircraft  lost  right  engine  cowling  and 

had  right  engine  failure  at  1,000’  in 
climb 

74.  MLG  Aircraft  had  smoke  in  the  cockpit  and 

pressurization  problems,  descended 
and  continued  to  destination 


75.  LRG  Go-around  due  to  no  gear  extension 
and  GPWS  warning 


76.  MLG  Aircraft  landed  with  the  cabin  not 

secured  and  with  flight  attendants  not 
in  assigned  landing  positions 


77.  LRG  Possible  health  hazard  to  ground 
personnel  from  operating  radar 


78.  SMT  Aircraft  aborted  takeoff  from  40’  in 
the  air  resulting  in  aircraft  damage 


Window  design  such  that  the  handle  appeared 
properly  in  place  but  the  securing  dogs  weren't 
properly  in  place,  window  is  not  a  checklist  item 
or  it  might  have  been  noticed 

Had  an  asymmetric  flap  procedure  on  landing,  used 
abnormal  list  and  normal,  during  the  confusion  and 
subsequent  relief  of  being  on  the  ground,  they 
forgot 

Crew  did  the  checklists  required  for  unretracted 
gear  doors,  used  all  published  procedures 


Switch  not  in  proper  position  to  allow 
pressurization,  was  answered  for  on  the  before¬ 
taxi  checklist  but  not  properly  checked 

Failure  of  door  seal,  used  all  appropriate  checklists 
and  landed  without  incident 

Busy  watching  traffic  ahead  on  final,  didn’t  extend 
gear  or  do  GUMP  check 

Improper  altitude  put  in  altitude  reminder  while 
F/O  was  busy  trying  to  do  the  checklists  and  talk 
with  ATC 

Flight  attendant  supposed  to  close  cockpit  door, 
inadequate  flight  attendant  training,  cockpit  door 
not  on  any  checklist 

Latches  to  the  cowl  are  supposed  to  be  checked  on 
preflight,  pilot  claims  he  did,  all  emergency 
procedures  followed,  uneventful  landing 

Did  the  electrical  smoke  or  fire  checklist,  isolated 
the  problem,  continued  to  destination  and  landed 
with  the  emergency  equipment  standing  by  on  the 
ground 

Crew  got  behind  the  program  with  an  approach  in 
the  weather  and  a  change  of  runways  during 
approach,  missed  the  gear  on  the  checklist 

Checklist  still  reflects  the  use  of  a  call  button  to 
alert  the  flight  attendants  at  the  time  the  no-smoke 
sign  was  turned  on  -  with  the  new  smoking  regs, 
the  no-smoke  sign  is  on  all  the  time  for  this  airline 
-  checklist  or  operating  policy  should  be  revised 

After  a  demanding  flight  the  crew  did  the  proper 
checklists  and  thought  they  had  turned  the  radar  to 
standby  -  radar  had  different  switching  than  what 
they  were  used  to  and  may  not  have  been  turned  to 
standby 

Pilot  took  off  with  the  control  lock  on  the  yoke  - 
didn’t  use  checklist  to  back  up  flow  pattern 
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79.  LRG 

80.  MLG 

81.  MLG 

82.  MLG 

83.  MIX} 

84.  LTT 

85.  SMA 

86.  MLG 

87.  MLG 

88.  LRG 

89.  MLG 

90.  MLG 


Aircraft  depressurized  requiring  use 
of  rapid  depressurization  and 
explosive  depressurization  checklists 
and  diversion  to  a  nearby  field 

Aircraft  declared  an  emergency  on 
climbout  and  returned  to  land 


Cracks  in  the  cabin  in  the  wheel  well  area  probably 
due  to  aircraft  age 


Engine  loss  on  climbout  with  use  of  emergency  and 
normal  checklists 


In  climb  the  aft  cargo  door  light 
illuminated,  unable  to  pressurize, 
continued  to  destination  and  landed 

Aircraft  unable  to  control 
pressurization,  horn  sounded,  masks 
dropped,  emergency  declared 

Didn’t  control  cabin  altitude,  got 
passenger  oxygen  masks,  recovered 
pressurization,  continued  to 
destination  climbing  above  25,000' 
illegally  (due  to  no  availability  of 
automatic  oxygen  mask  presentation) 
to  avoid  weather 

Near  mid-air  collision,  took  evasive 
action 


Aircraft  landed  gear  up  after  an 
aborted  landing  and  go-around 


Cargo  door  light  not  noticed  during  pre-takeoff 
checklists,  continued  due  to  below  landing 
minimums  at  departure  point 

Loss  of  pressurization,  cause  unknown,  used 
emergency  checklists  and  procedures,  continued  to 
destination  at  lower  altituae 

Bleed  switches  not  on  and  not  noticed  out  of  the 
proper  position  on  the  checklist 


Busy  doing  checklist  for  descent  and  both  had 
heads  inside  the  cockpit,  although  under  positive 
control,  the  controller  didn’t  point  out  the  traffic 

Too  much  float  on  a  hot  day,  went  around.  Didn’t 
put  gear  down  for  second  approach,  did  a  GUMP 
check  and  missed  the  gear,  gear  horn  didn’t  work 
because  of  high  approach  power  setting 


Loss  of  pressurization  and  emergency  Lost  both  packs  simultaneously,  used  emergency 
descent  checklists  and  descent,  donned  oxygen  masks,  both 

packs  came  back  on  the  line,  continued  to 
destination,  cause  unknown 


Jetway  shifted  causing  minor  aircraft 
damage,  blamed  on  aircraft  rolling 

Near  overtemp  on  starting  engine  #1 


Aircraft  rolled  forward  on  engine 
start,  brakes  applied  suddenly  causing 
flight  attendants  to  fall  with  two 
sustaining  minor  injuries 


Brakes  were  set  per  the  securing  checklist 


At  a  stop  on  a  through  flight  maintenance  had  been 
working  on  a  thrust  reverser  problem,  start  levers 
had  been  left  in  idle  rather  than  cutoff  during  the 
work,  this  was  not  caught  prior  to  start  since  “start 
levers  to  cutoff”  is  not  on  the  before  start  checklist 
on  a  through  flight 

Brakes  not  set  during  checklist,  chocks  pulled  by 
ground  crew  without  informing  cockpit  crew,  non¬ 
standard  procedure  for  use  of  parking  brakes  prior 
to  engine  start 


Damage  to  aircraft  tow  bar  during  Abnormal  start  due  to  APU  electrics  inop,  no 

pushback  specific  checklist  to  cover,  used  normal  flow 

pattern  during  an  abnormal  start 
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1.  MLG 

Aircraft  landed  without  clearance 
from  the  tower 

Two-man  crew,  very  busy  trying  to  locate  an 
unfamiliar  airport,  doing  checklists,  etc. ,  didn't 
switch  frequencies 

2.  MLG 

Aircraft  overshot  altitude  in  descent, 
on  autopilot 

Autopilot  sensing  taken  off  F/O  altimeter  which 
was  set  1  inch  too  high  (30.79"  vs.  29.79") 

3.  MLG 

Aircraft  overshot  altitude  in  climb 

Aircraft  on  test  flight,  two-man  crew,  pilot  flying 
new  on  aircraft,  pilot  not  flying  overly  busy  with 
extensive  test  flight  checklist  and  didn’t  call  1000’ 
before  the  altitude 

4.  WDB 

Aircraft  overshot  altitude  on  SID 

Preoccupation  with  the  checklist  and  no  call  for 
1000’  before  the  altitude 

5.  MLG 

Aircraft  overshot  altitude  on  descent 

Two-man  crew  fairly  new  to  the  airplane,  busy 
running  checklists  and  other  duties,  knocked  off 
altitude  hold  by  mistake  and  didn’t  catch  it  until 
after  descent  below  assigned  altitude 

6.  MLG 

Aircraft  emergency  evacuation 
leaving  the  ramp 

Alleged  right  engine  fire,  ran  emergency  checklists 
and  did  emergency  evacuation 

7.  MLG 

Aircraft  overshot  altitude  in  climb 

Didn’t  reset  altimeters  at  18,000’  and  didn’t  catch 
it  on  the  checklist 

8.  MLG 

Runway  incursion  during  taxi 

Crew  busy  doing  checklists  and  briefing 

9.  MLG 

Altitude  excursion,  aircraft  on 
autopilot 

Crew  busy  doing  checklists  and  other  duties,  did 
not  catch  the  fact  that  the  autopilot  had  gone  to 
another  mode  and  started  to  climb 

10.  MLG 

Near  mid-air  collision,  took  evasive 
action 

Aircraft  level,  crew  busy  changing  radio  and  doing 
checklist,  looked  up  to  see  small  aircraft  very  close 
at  the  same  altitude,  no  mention  by  the  controller 

11.  MLG 

Emergency  descent  made  and 
emergency  declared,  couldn’t  control 
cabin  altitude 

Did  emergency  checklists,  auto  pressurization  lost, 
regained  control  with  manual  pressurization, 
continued  to  destination 

12.  MLG 

Near  mid-air  collision,  no  time  for 
evasive  action 

Aircraft  in  level  flight  under  positive  control,  did 
outside  check,  dropped  eyes  to  checklist,  looked 
back  up  to  see  an  aircraft  within  150’  crossing  at 
the  same  altitude,  no  mention  by  the  controller 
although  the  controller  did  say  afterwards  he  had 
the  aircraft  on  radar 

13.  WDB 

Aircraft  overshot  turn  to  final 

Crew  busy  programming  the  FMC  and  doing 
checklist,  got  behind  the  airplane  and  didn't  get 
into  the  slot  until  1000’ 

14.  WDB 

Aircraft  aborted  T/O 

F/O  sliding  window  came  open  on  T/O,  not 
latched  properly,  item  not  on  checklist  for  positive 
check 

15.  WDB 

Questionable  descent  clearance 

Crew  busy  doing  checklists,  handling  multiple 
radios,  etc.,  got  a  descent  clearance  from  one 
controller,  a  frequency  change,  and  the  follow  mg 
controller  questioned  the  altitude 
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OCCURRENCE 

CAUSE 

16.  MLGA 

Aircraft  undershot  crossing  altitude 

Crew  busy  getting  ATIS,  working  radio,  doing 
checklists,  tuned  wrong  VOR  frequency,  and  didn’t 
make  crossing  restriction 

17.  MLG 

Altitude  overshoot  on  descent, 
aircraft  on  autopilot 

Captain  busy  with  checklist,  F/O  programmed  the 
autopilot  wrong  and  knocked  off  altitude  hold 

18.  MLG 

Altitude  overshoot  on  climb 

Maximum  performance  climb,  light  aircraft,  tired 
crew,  busy  doing  checklist  and  working  radio, 
didn’t  reset  altimeter  soon  enough  and  went 
through  the  assigned  altitude 

19.  MLG 

Altitude  overshoot  on  climb 

Late  at  night,  long  flight  sequence,  light,  fast 
climbing  aircraft,  multiple  frequency  changes, 
doing  checklist,  didn’t  catch  it 

20.  WDB 

Altitude  overshoot  in  climb 

Crew  didn’t  reset  altimeters  to  29.92"  1 1  18,000’, 
distracted  from  the  checklist  by  turbulence 

21.  LRG 

Aircraft  missed  crossing  restriction 

Due  to  multiple  frequency  changes  and  looking  for 
traffic  climb  checklist  was  never  done,  and 
altimeters  weren’t  reset 

22.  MLG 

Momentary  application  of  heavy  aato 
brake  on  landing,  resulted  in  a  very 
noticeable  lurch  during  rollout 

While  doing  the  landing  checklist  the  F/O 
inadvertently  programmed  the  auto  brake  for  T/O, 
due  to  darkness  and  having  to  do  a  360  degree  turn 
on  final,  the  error  was  not  caught 

23.  MLG 

Aircraft  several  thousand  feet  high  on 
crossing  restriction 

Poor  crew  coordination,  inexperience  on  tbe 
aircraft  and  that  portion  of  the  route  structure  for 
the  captain,  running  the  checklist 

24.  MLG 

Probable  needless  engine  shutdown  in 
flight,  emergency  declared  with  a 
precautionary  landing  short  of  the 
destination 

While  performing  the  checklist  for  an  electrical 
abnormal,  captain  mistook  an  APU  low  oil 
pressure  light  for  an  engine  low  oil  pressure  light 
and  shut  down  the  engine,  poor  crew  coordination 
while  doing  electrical  abnormal  and  F/O  was 
starting  the  APU 

25.  MLG 

Altitude  overshoot  on  climbout 

Captain  had  called  1000’  before  the  altitude  and 
got  busy  doing  something  else,  F/O  looked  away  to 
do  something  that  wasn't  called  for  on  the  checklist 
at  that  point  and  went  through  the  altitude 

26.  MLG 

Altitude  overshoot  on  climbout 

Very  short  flight,  frequency  changes  (both 
company  and  ATC),  auto  throttles  not  operating, 
doing  checklists,  overloaded  two-man  crew 

27.  WDB 

Altitude  overshoot  on  descent 

Busy  two-man  crew,  set  improper  altimeter  and 
overshot  by  1000’ 

28.  MLG 

Altitude  overshoot  on  descent 

Two-man  crew  doing  checklists  and  other  duties  on 
descent  for  landing,  altitude  capture  not  set  on 
autopilot,  no  altitude  warning  on  the  aircraft, 
caught  by  the  crew  after  they  had  overshot 

29.  MLG 

Speed  deviation  on  STAR 

Captain  handflying  aircraft  for  practice,  F/O  doing 
checklists,  handling  radio,  etc. ,  both  missed  the 
speed  restriction  on  the  STAR 

30.  WDB 

Altitude  undershoot  in  climb 

Crew  neglected  to  reset  altimeters  to  29.92"  at 
18,000’,  missed  it  on  the  checklist 
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31.  MLG 

Near  mid-air  collision  on  arrival 
route,  took  evasive  action 

Crew  doing  checklists  and  crosschecking  settings 
on  instruments  as  per  company  policy,  just  missed 
other  aircraft  crossing  the  arrival  route,  no  warning 
from  the  controller 

32.  MLG 

Altitude  overshoot  in  climb 

New  capt.,  new  copilot,  new  airplane,  new  airport, 
very  rushed,  rushed  the  checklists  (missing  an 
item),  un familiarity  with  autopilot  resulted  in 
overshoot 

33.  MLG 

Altitude  overshoot  on  descent 

Forgot  to  reset  altimeter  leaving  18,000’  in  the 
descent 

34.  MLG 

Altitude  overshoot  on  descent 

Read  in  range  checklist  completely  at  24,000  and 
missed  the  altimeter  reset  at  18,000’,  premature 
completion  of  the  list 

35.  WDB 

Altitude  overshoot  on  descent 

Two-man  crew,  between  310  and  180  had  five 
speed  changes  and  two  hdg.  changes,  one  altimeter 
got  reset,  the  one  of  the  pilot  flying  did  not;  in 
addition,  after  the  overshoot  there  were  three  more 
speed  changes,  two  more  hdg.  changes  and  three 
runway  changes  (the  last  one  taking  place  at  400’ 
on  finali.  THIS  IS  RIDICULOUS 

36.  MLG 

Aircraft  almost  aligned  with  the 
wrong  runway  for  landing,  FAA 
check  airman  on  board  nude  no 
comment,  caught  the  error  in  time 

Capt.  busy  looking  for  airport,  running  checklists 
and  helping  recent  upgrade  copilot 

37.  MLG 

Aircraft  almost  departed  on  a  runway 
which  was  too  short  for  their  weight, 
caught  by  the  company  and  relayed 
by  die  tower  controller 

Runway  was  the  longer  of  the  two  and  into  the 
wind,  but  had  a  terrain  restriction,  crew  was  busy 
doing  checklists  and  tending  to  a  passenger 
problem  and  didn’t  actually  check  the  performance 
charts  for  the  runway 

38.  WDB 

Crew  returned  to  ramp  to  have  an 
extended  spoiler  fixed,  spotted  by 
crew  of  a  following  aircraft 

Taxiing  with  one  engine  shut  down,  holding  off  on 
checklist,  takeoff  position  advanced  by  controller, 
rushed  to  complete  everything  and  missed  indicator 
light  for  partially  extended  spoiler 

39.  MLG 

Aircraft  almost  departed  with  seat 
belt  sign  off  and  correct  takeoff 
power  settings 

Rushed  turnaround,  trying  to  beat  a  curfew,  rushed 
checklists  and  missed  items,  caught  on  the  taxi  for 

T/O 

40.  MLG 

Altitude  overshoot  in  descent 

Training  flight,  instructor  busy  doing  checklists  and 
instructing,  autopilot  lost  the  altitude  hold  and 
neither  pilot  caught  it  until  after  the  overshoot 

41.  MLG 

Aircraft  crossed  runway  hold  line 
during  taxi  after  instructions  to  hold 
short,  potential  conflict 

Two-man  crew  doing  challenge  and  response 
checklists  and  required  PA  announcements  and 
missed  holding  short 

42.  MLG 

Aircraft  landed  without  clearance 
from  the  tower 

Heavy  traffic,  a  great  deal  of  maneuvering  close 
in,  busy  doing  checklists,  didn’t  switch  over  from 
approach  to  tower 

43.  MLG 

Altitude  overshoot  on  climbout 

Pilot  flying  new  on  the  aircraft,  pilot  not  flying 
busy  with  communications,  traffic  watch  and 
checklists,  pilot  flying  did  not  reset  altimeter  and  it 
was  not  caught  on  the  checklist 

C-ll 

CAUSE 


AIRCRAFT  OCCURRENCE 
TYPE 


44.  MLG  After  liftoff  a  door  light  came  on  and 

aircraft  could  not  be  pressurized, 
returned  to  land 

45.  MLG  Minor  overshoot  on  descent 


46.  MLG  Altitude  overshoot  on  descent 


47.  MLG  Altitude  overshoot  and  excessive 
speed 


48.  WDB  Altitude  undershoot  on  climb  and 

missed  altimeter  on  approach 

49.  SMA  Possible  near  miss 


50.  WDB  Left  engine  running  after  the  securing 
checklist  and  leaving  the  aircraft 


51.  SMT  Altitude  overshoot,  possible  conflict 
with  other  traffic 


52.  MLG  Aircraft  landed  with  considerable  fuel 
imbalance 


53.  LRG  Aircraft  overshot  approach  course, 

corrected  for  normal  approach  and 
landing 

54.  MLG  Altitude  overshoot  on  descent 


55.  MLG  Flight  departed  with  less  than  planned 

fuel  load 

56.  MLG  Altitude  overshoot  on  descent  for  ILS 


57.  MLG  Aircraft  would  not  pressurize  in 

climb 

58.  MLG  Partial  hydraulic  loss,  manual  gear 

extension 


On  door  light  checks  on  the  checklists  on  tke 
ground  the  door  light  was  not  illuminated 


Contributing  factors  were  preoccupation  with 
checklist  and  PA 

New  capt.  getting  line  operating  experience,  doing 
checklist,  changing  frequencies,  getting  ATIS,  de¬ 
icing  airplane,  autopilot  did  not  capture  properly, 
also  no  altitude  alert  on  this  type  of  aircraft  when 
it  is  on  all  the  rest  of  the  fleet,  nonstandardization 

Light  aircraft  with  a  fast  climb,  crew  busy  doing 
checklists,  frequency  changes,  etc.,  got  way  behind 
the  airplane,  attempting  mixed  use  of  autothrottle 
and  manual  control  unsuccessfully 

Sloppy  use  of  checklists 


Pilot  had  been  in  contact  with  approach,  had  been 
given  a  discrete  code  and  cleared  below  the  LAX 
TCA,  approach  did  not  pass  on  info  to  LAX, 
passed  near  inbounds  to  LAX  that  apparently  did 
not  see  him 

Did  not  physically  check  that  fuel  control  switches 
were  in  cutoff,  fuel  control  switch  positions  easily 
confused 

Crew  busy  doing  arrival  prep  such  as  PA,  ATIS, 
checklists,  etc.,  misunderstood  altitude  cleared  to 
and  descended  too  low 

Crossfeeding  taking  place,  did  not  reinstate  proper 
fuel  pump  configuration  before  landing,  should  be 
an  item  on  the  checklist  for  fuel  pump 
configuration 

Unintelligible  controller  instructions,  interruptions 
of  checklist,  missed  proper  inbound  course  setting 
on  resumption  of  checklist 

Descent  on  autopilot,  checklists  in  progress, 
autopilot  failed  to  capture  altitude,  recovered 
manually 

Aircraft  not  fueled,  did  not  properly  check  the  fuel 
load  on  the  pre-engine  start  checklist 

Aircraft  programmed  for  automatic  ILS  approach 
capture,  while  crew  was  busy  doing  the  before 
landing  checklist  the  FMS  intercepted  the  localizer 
and  began  a  premature  descent,  corrected  manually 

Cabin  altitude  control  lever  in  the  wrong  position, 
missed  on  checklist 

Used  appropriate  abnormal  hydraulic  checklist 
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TYPE 


59.  LRG 

60.  MLG 

61.  LRG 

62.  WDB 

63.  MLG 

64.  MLG 

65.  WDB 

66.  MLG 

67.  MLG 

68.  LIT 

69.  MLG 

70.  MLG 

71.  MLG 

72.  MLG 


Altitude  overshoot  of  1000’  in  Altimeter  set  incorrectly  by  1”,  not  caught  on  two 

descent  checklists 


Altitude  overshoot  on  climbout  Distracted  by  radio,  setting  instruments,  and 

checklists,  didn’t  make  1000'  before  altitude 
callout,  altitude  reminder  sounded 


Altitude  overshoot  on  descent 


Crew  busy  getting  ATIS,  doing  descent  and 

abroach  checklist,  set  altimeter  improperly, 

6 meter  setting  not  checked  with  that  issued  by 
ATC 


Aircraft  declared  an  emergency, 
smoke  in  the  cockpit,  diverted  to  land 
short  of  destination 

Aircraft  lost  comm  on  an  active 
runway,  caused  a  go-around 

Altitude  overshoot  in  descent 


Aircraft  landed  without  clearance 


Aircraft  landed  without  clearance 


Altitude  overshoot  on  descent 


Near  collision  on  a  runway,  aircraft 
cleared  into  position  to  hold  on  a 
runway  where  another  aircraft  had 
been  cleared  for  T/O 


Various  annunciator  warnings,  smoke  in  the 
cockpit,  used  oxygen  masks,  ran  normal  checklists 
but  no  emergency  checklists  were  mentioned 

Crew  busy  doing  checklist  and  final  items  for  T/O, 
didn’t  notice  a  comm  switch  in  the  off  position 

Fatigue,  descending  in  bright  sunlight,  hydraulic 
pump  activation  caused  a  voltage  spike  knocking 
off  the  autopilot  altitude  hold,  also  making  PA 
announcement,  crew  did  not  notice  autopilot  not 
engaged  when  running  checklist 

Approach  during  rough  weather,  crew  busy 
controlling  aircraft  and  doing  checklist,  dialed  in 
wrong  frequency  and  didn’t  catch  it  until  on  the 
ground 

Approach  control  didn’t  switch  the  flight  over  to 
tower,  crew  busy  running  checklist,  etc.,  didn’t 
catch  it  until  on  the  ground 

Doing  checklist,  reset  altimeter  for  local  pressure 
when  only  cleared  to  18,000’,  altitude  alert  is  only 
triggered  by  captain’s  altimeter,  not  both,  so  didn’t 
sound 

Crew  busy  doing  checklist  but  did  hold  short  to 
check  runway  as  everyone  should,  saw  other 
aircraft  rolling  and  held  short 


Altitude  undershoot  in  climbout 


Altitude  undershoot  in  descent,  went 
below  crossing  restriction 


Altimeter  not  reset,  crew  busy  running  checklists 
and  handling  aircraft  in  bad  weather,  NEW 
CHECKLIST  PROCEDURE  HAS  ALTIMETERS 
RESET  FROM  OFE  TO  ONH  AT  10.000’  -  TOO 
LATE  FOR  ACCURATE  USE  WHEN 
ASSIGNED  AI.TmJDF.S  BELOW  10.000’ 


New  capt.,  low  light  level,  high  workload 
including  running  checklists,  misread  DME  for 
crossing  restriction,  other  pilot  did  not  recheck  on 
his  chart 


Aircraft  didn’t  make  crossing  Two-man  aircraft,  high  work  load  including 

restriction  checklists,  controller  confusion  as  to  a  prior 

restriction 


Altitude  undershoot  in  descent,  Pilot  flying  busy  with  aircraft  in  turbulence  and 

missed  crossing  restriction  icing  conditions,  non-standard  crossing  restriction, 

pilot  not  flying  out  of  the  loop  doing  the  checklist 
C-13  and  didn't  catch  the  error 


OCCURRENCE 


AIRCRAFT 

TYHE 


73.  MLO 

Altitude  overshot  in  climbout 

Pilot  not  flying  busy  doing  checklist  during  a  high 
rate  climb  at  tow  level,  altitude  alert  nonstandard 
from  other  aircraft  in  the  fleet,  pilot  flying 
distracted  temporarily 

74.  MLO 

Altitude  overshoot  in  climbout, 
aircraft  would  not  pressurize 

IfiKUmute  preflight  and  checklist  use  didn’t  catch 
locked  open  outflow  valves,  aircraft  wouldn’t 
pressurize  and  momentarily  distracted  crew 
attention  from  the  altitude 

75.  WDB 

Wild  autopilot  oscillations  in  flight, 
corrected  by  going  to  manual  control 

Crew  didn’t  turn  on  pitot  heat,  didn’t  catch  it  on 
the  checklist,  pitot  tube  iced  up  causing  airspeed 
indication  lost  which  sent  incorrect  speed  to  the  air 
data  computer  resulting  in  rudder  inputs  for  lower 
speeds  when  aircraft  was  at  high  speed 

76.  MLG 

Passed  hold  short  point  on  a  taxiway 
cutting  off  another  aircraft 

Two-man  crew  busy  doing  checklists  and  working 
ground  and  company  radio,  capt.  misunderstood 
the  taxi  instructions  and  F/O  didn’t  monitor  closely 
enough  because  of  other  duties 

77.  MLG 

Altitude  overshoot  in  climbout 

Pilot  not  flying  reading  the  checklist,  failed  to  call 
1000’  before  the  altitude,  ACARS  message  came 
across  at  the  same  time  as  they  hit  the  assigned 
altitude 

78.  MLG 

Altitude  overshoot  in  climbout,  not 
caught  by  controller 

Crew  busy  doing  checklist  and  other  duties,  wrong 
altitude  set  in  the  altitude  reminder,  overshot  and 
in  the  overshoot  received  a  clearance  to  higher 
altitude 

79.  WDB 

Altitude  overshoot  in  descent 

Two-man  crew  busy  in  arrival  procedures  in  busy 
area,  bad  weather,  copilot  busy  doing  comm,  etc., 
capt.  flying  aircraft,  programming  the  computer 
and  doing  checklists,  missed  altimeter  reset  at 
18,000’ 

80.  MLG 

Possible  missed  crossing  restriction 
on  both  altitude  and  speed 

Aircraft  developed  a  pressurization  problem  in 
descent,  crew  busy  doing  abnormal  procedure  and 
flying  aircraft  missed  crossing  restrictions,  but  at 
the  same  time  the  controller  gave  them  new  altitude 
and  heading  which  cancelled  prior  restrictions 

81.  MLG 

Altitude  overshoot  in  climbout 

Lower  altitude  assigned  than  original  clearance 
when  aircraft  was  almost  at  the  new  assigned  and 
at  a  high  climb  rate,  also  distracted  doing  the 
checklist  and  altimeter  didn’t  get  reset 

82.  MLG 

Altitude  undershoot  in  climbout, 
missed  crossing  restriction 

Changes  in  altitude  clearance  by  departure,  crew 
busy  doing  checklist  and  other  departure  duties  and 
turned  prematurely  resulting  in  lower  altitude  at 
crossing  point 

83.  MLG 

Complaint  concerning  close  parallel 
approaches 

Reporter  suggests  staggering  aircraft,  in  addition  to 
being  alarming  to  passengers  it  distracts  from 
checklist  and  other  duties 

84.  WDB 

Aircraft  experienced  multiple 
electrical  failures,  declared  an 
emergency  and  landed  short  of 
destination 

Proper  use  of  abnormal,  emergency  and  normal 
checklists 

85.  MLG 

Runway  incursion 

Aircraft  had  been  cleared  to  hold  short,  F/O  busy 
doing  checklist  and  not  listening,  capt. 
misunderstood  clearance 
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86.  MLG 


87.  WDB 


88.  MLG 

89.  WDB 


90.  MLG 

91.  MLG 

92.  MLG 

93.  MLG 

94.  MLG 


1 


95.  WDB 

96.  MLG 

97.  LRG 

98.  MLG 


Engine  oil  leek  caused  further  engine 
problems  resulting  in  shutdown,  other 
generator  didn’t  pick  up  die  lost  load 


Aircraft  had  to  return  to  land  due  to 
two  cargo  doors  open 


Altitude  undershoot  on  climb 


Aircraft  took  off  over  weight  on  a 
limited  runway  with  antiskid  inop 


Cabin  altitude  climbed  above  10,000’ 
with  no  altitude  warning  horn, 
passenger  oxygen  masks  deployed, 
returned  to  departure  point 

Aircraft  overshot  altitude  on  profile 
descent 


Altitude  undershoot  in  climb 


Altitude  overshoot  during  STAR 
Unauthorized  landing 


Aircraft  took  off  with  gear  pins 
installed  and  had  to  return  to  land 

Aircraft  took  off  with  nose  gear  pin 
installed  and  had  to  return  to  land 


Aircraft  overshot  altitude  in  climb 


Altitude  overshoot  during  descent, 
less  than  standard  separation  with 
other  aircraft 


Confusion  in  the  cockpit  due  to  nonstandardization 
of  fleet,  compounding  problems,  controller  queries 
during  a  busy  time,  DIFFICULTY  IN  LOCATING 
THE  EMERGENCY  CHECKLIST 

Glass  cockpit  airplane,  CRT  wiped  clean  during  the 
fire  test  in  before  starting  engines  checklist, 
misconception  from  training  concerning  recall  of 
items  to  the  CRT  after  start  led  to  not  seeing  doors 
open  light  (crewmember  had  been  led  to  believe 
that  information  was  automatically  displayed  on 
power  change  over  after  start  when  it  had  to  be 
recalled  manually) 

Reset  of  altimeter  at  18,000'  is  not  on  the  checklist 
and  the  crew  forgot  it 

Rushed  departure  after  maintenance  delay  working 
on  antiskid,  very  short  taxi  with  rushed  checklists 
and  engine  start,  message  on  weights  to  check 
dispatcher  for  reduced  VI  speed,  dispatcher 
referred  them  to  manuals,  manuals  poorly  set  up  to 
get  info,  two-man  crew  in  busy  environment  unable 
to  find  info  readily 

Proper  use  of  appropriate  checklists,  inop  cabin 
altitude  warning  horn  and  auto  pressurization 


Aircraft  on  autopilot  with  altitude  hold  engaged, 

Cilot  not  flying  doing  checklist,  altitude  warning 
om  did  not  sound  and  autopilot  did  not  capture 
altitude 

Altimeters  not  reset,  didn’t  catch  it  in  the  checklist, 
low  flight  crew  experience  level,  fleet 
nonstandardization 

Flight  crew  distracted  doing  checklist 

Crew  given  poor  vectors  to  final  and  then  turned 
on  for  a  short,  steep  descent  for  landing,  thought 
they  heard  a  clearance  which  was  for  another 
aircraft  -  this  aircraft  uses  a  mechanical  checklist 
with  two  blanks  for  "cleared  for  the  approach*  and 
"cleared  to  land"  -  thinking  he  had  heard  that,  the 
copilot  moved  the  slides  indicating  to  the  capt.  that 
clearance  was  received 

Crew  distracted  by  maintenance  while  reading  the 
checklist  and  missed  the  gear,  pins 

F/O  distracted  on  walkaround  by  new  hire 
accompanying  him,  missed  nose  gear,  PIC  can’t 
see  gear  pins  in  the  cockpit  as  on  other  aircraft  in 
the  fleet,  missed  on  the  checklist 

Aircraft  in  heavy  weather,  pilot  flying  called  for 
the  climb  check,  aircraft  sustained  a  lightning 
strike,  misread  autopilot  annunciators,  and  changed 
autopilot  settings  resulting  in  an  overshoot 

Two-man  crew  in  busy  environment,  running 
checklists,  etc.,  and  altitude  alert  didn’t  sound 
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AIRCRAFT 

TYPE 

OCCURRENCE 

CAUSE 

99.  LTT 

Aircraft  landed  without  clearance 

Busy  airport,  crew  monitoring  heavy  in  close 
proximity  for  the  parallel  runway,  doing  checklist, 
didn’t  contact  tower 

100.  MLG 

Altitude  overshoot  in  descent 

Crew  didn’t  reset  altimeter  at  18,000’,  caught  later 
when  they  ran  the  checklist  after  the  overshoot 

101.  MLG 

Aircraft  landed  on  the  wrong  runway 

Being  vectored  for  one  runway,  confusion  over 
controller  comments  concerning  another,  busy 
running  checklist 

102.  MLG 

Aircraft  flew  wrong  radial  on 
departure 

Not  set  properly  in  nav  instruments  prior  to 
departure  and  not  caught  on  checklist 

103.  MLG 

Aircraft  missed  crossing  restriction 

Concern  over  airport  below  minimums,  discussing 
alternate  plans,  busy  running  checklist 

104.  MLG 

Altitude  overshoot  of  1100’  on 
climbout 

Automated  cockpit  set  to  altitude  capture  with 
autothrottles  set,  crew  doing  checklist,  autopilot  did 
not  capture 

105.  MLG 

Aircraft  missed  crossing  restriction 

Crew  busy  doing  checklist  items,  clearance 
misunderstood  by  the  pilot  flying  and  not  caught  in 
time  by  the  other  pilot 

106.  LRG 

Altitude  overshoot  on  short  final 

Doing  checklist  in  turbulence,  pilot  flying  altimeter 
set  off  1",  multiple  approach  control  course  and 
speed  changes,  mistake  not  caught  until  GPWS 
sounded  and  approach  control  altitude  alert  sounded 

107.  MLG 

Altitude  overshoot  on  climbout 

Crew  busy  looking  for  t  affic  and  doing  checklist, 
new  crew  to  aircraft  in  i  -oth  seats,  high 
performance  climb  with  a  2000’  assigned  altitude 

108.  LRG 

Altitude  undershoot  at  top  of  climb 
and  in  cruise,  not  noticed  until 
descent  for  landing,  controller  didn’t 
catch 

Crew  new  to  the  airplane,  both  used  to  three-man 
crew,  now  on  a  two-man  aircraft,  missed  setting 
altimeters  at  18,000'  and  didn’t  catch  it  on  the 
checklist 

109.  MLG 

Aircraft  experienced  loss  of 
pressurization,  made  emergency 
descent  and  declared  an  emergency 

Appropriate  checklists  used 

110.  MLG 

Engine  flame-out  at  altitude  from  fuel 
exhaustion,  emergency  declared,  got 
engine  relight  at  Tower  altitude 

Ran  the  main  tanks  dry  with  a  lot  of  fuel  in  the 
center  tank,  didn’t  have  all  the  boost  pumps  on  and 
didn’t  catch  it  on  the  checklist 

111.  MLG 

Altitude  deviation  during  approach 

Two-man  crew,  very  busy  environment  with  many 
heading  and  speed  changes,  frequency  changes, 
ATIS,  reading  the  checklist  -  one  pilot  thought  he 
heard  a  clearance  and  started  down,  clearance  not 
confirmed  because  of  frequency  congestion 

112.  MLG 

Altitude  overshoot  on  climbout 

Due  to  loss  of  partial  aircraft  systems  and  transfer 
of  aircraft  control  and  subsequent  abnormal 
checklists  altimeter  was  not  reset  at  18,000’,  the 

transition  level  altimeter  reset  is  not  on  a  checklist 
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AIRCRAFT 

TYPE 

OCCURRENCE 

CAUSE 

113.  WDB 

Aircraft  failed  to  pressurize,  returned 
to  point  of  departure 

Neither  air  conditioning  pack  was  operating,  no 
checklist  for  that  abnormal  procedure,  returned  and 
found  a  start  arm  switch  in  the  wrong  position, 
didn’t  catch  it  on  the  checklist  after  starting 
engines,  the  only  checklist  for  packs  inop  is  found 
under  the  expanded  checklist  for  rapid 
decompression  (77?) 

114.  WDB 

Aircraft  landed  without  clearance 

Crew  busy  with  tight  approach  and  doing  checklist, 
didn’t  contact  tower  until  after  rollout,  tower  didn’t 
even  know  they  had  landed 

115.  MLG 

Engine  flamed  out,  single  attempt  at 
restart  unsuccessful,  landed  short  of 
destination 

Used  all  appropriate  checklists,  abnormal, 
emergency,  and  normal 

116.  MLG 

Aircraft  taxied  into  position  on  an 
active  runway,  possibly  without 
clearance 

Confusion  as  to  controller  instructions,  capt.  called 
for  last  items  on  the  before  takeoff  checklist  which 
are  normally  done  only  when  cleared  into  position 

117.  MLG 

Near  mid-air  collision 

Aircraft  on  approach,  on  autopilot  and 
autothrottles,  crew  was  busy  changing  frequencies 
and  doing  the  checklist,  when  they  looked  up  the 
other  aircraft  was  crossing  300’  above  and  about 
700’  out 

118.  LRG 

Aircraft  landed  without  clearance 

Making  a  coupled  approach  for  an  autoland,  doing 
checklists,  fatigue,  forgot  to  shift  frequencies 

119.  LTT 

Aircraft  crossed  an  active  runway 
after  instructed  to  hold  short 

Copilot  got  instructions,  assumed  captain  had  them, 
started  to  do  the  checklist  heads  down  and  didn’t 
catch  the  crossing,  poor  crew  coordination 

120.  MLG 

Aircraft  filled  with  smoke  at  37,000’, 
declared  an  emergency  and  landed 
short  of  destination 

Used  appropriate  checklists  and  procedures 

121.  WDB 

Partial  runway  incursion,  caused  a 
go-around 

Crew  busy  doing  checklist,  misunderstood 
clearance  to  taxi  up  to  and  hold  short,  taxied 
beyond  the  hold  short  point 

122.  WDB 

Deviation  from  assigned  SID 

During  taxi  aircraft  received  runway  changes, 
changed  SID  in  FMS,  runway  reassigned,  in  doing 
the  checklist  and  other  duties,  SID  didn’t  get 
changed  again 

123.  MDT 

Altitude  overshoot  on  climbout 

Crew  busy  dodging  thunderstorms  on  departure, 
changing  frequencies,  flying  the  aircraft,  doing 
checklist,  no  altitude  warning  on  the  MDT  when 
Capt.  had  been  flying  an  airplane  that  had  one 

124.  MLG 

Aircraft  had  abnormal  lights  prior  to 
VI,  continued  T/O,  had  engine  fire 
warning  at  V2,  lights  went  out  and 
they  continued  to  destination 

Poor  procedures,  did  an  abnormal  checklist  for  an 
air  conditioning  supply  temp  high,  when 
maintenance  checked  the  aircraft  they  found  a  1 " 
hole  in  the  engine  where  the  starter  had  reengaged 

125.  WDB 

Engine  disintegrated  at  about  Vi, 
crew  aborted,  residual  fire  put  out  by 
emergency  crew 

Crew  followed  proper  procedure  and  used 
appropriate  checklists 

126.  MLG 

Engine  not  shut  down  prior  to  exiting 
aircraft 

Stressful  flight,  stress  resulting  from  merger,  poor 
crew  coordination,  lack  of  use  of  checklist 
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OCCURRENCE 


cause 


127.  WDB  Inaccurate  navigation,  deviation  from 

aaaigned  track 

128.  MLG  Altitude  overshoot  during  descent 


129.  WDB  Both  engines  shut  down  at  1500*  in 
climb,  restarted  and  continued  flight 


130.  WDB  Altitude  overshoot  during  approach 


131.  MLG  Engine  failure  in  cruise,  declared 
emergency,  landed  at  the  nearest 
suitable  airport 


FMS  programmed  improperly,  should  have  been 
caught  on  review  of  programming  for  checklist 

Crew  busy  handling  communications  with  company 
and  ATC,  doing  PA  announcements,  running 
checklists,  set  wrong  altitude  into  the  altitude 
reminder 

Capt.  did  not  use  the  checklist  for  an  abnormal 
annunciator  light,  used  the  wrong  switches  to  solve 
the  problem,  no  crew  coordination 

Controller  cleared  the  aircraft  to  3000’,  thought  he 
had  cleared  them  to  4000’,  they  got  busy  doing 
checklists  and  other  duties  and  descended  to  2600’ 

Shutdown  due  to  high  EGT  and  low  EPR,  used 
appropriate  checklists 


132.  MLG  Cargo  compartment  fire,  emergency 
not  declared  since  aircraft  was  on 
final  for  landing,  did  declare  an 
emergency  on  the  ground  with  a 
passenger  evacuation 


Illegally  shipped  hazardous  cargo,  crew  indicated 
that  with  a  two-man  crew  in  this  type  of  situation, 
trying  to  fly  the  aircraft,  do  checklists  and 
everything  else,  one  person  is  "out  of  the  loop’ 
trying  to  get  information  on  the  problem  and  the 
other  person  is  left  to  do  everything  else 


133.  WDB 


134.  WDB 


Engine  flame-out  when  throttles  were 
retarded  for  descent 


Unable  to  control  cabin  altitude, 
descended  to  control 


Proper  checklists  used  including  restart  checklist, 
successful  restart,  problem  caused  by  bad  bleed 
valve  which  is  in  the  process  of  modification 
tleetwide 

Engine  start  switch  in  the  wrong  position  for  pack 
operation,  should  have  been  caught  on  the  after 
starting  checklist 


135.  MLG  Aircraft  departed  with  incorrect  fuel 
load,  had  to  make  a  fuel  stop 


During  predeparture  checklists  the  crew  was 
distracted  by  on  board  FAA  inspectors,  didn’t 
cneck  fuel  properly 
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APPENDIX  D 

Form  and  Results  of  ALPA  Survey 


The  reasons  for  the  survey  are  fivefold.  Each  reason  will  have  its  own  set  of  questions.  The  reasons  are  as 
follows: 


1)  Identify  layout  and  other  design  characteristics  of  checklists  that  inhibit  or  promote  easy  use; 

2)  Determine  what  aspects  of  flight  operations  interfere  with  checklist  use,  and  identify  the  phases  of 
flight  during  which  these  distractions  are  most  likely  to  occur; 

3)  Determine  the  degree  to  which  checklist  procedures  are  defined  in  the  pilot  handbook; 

4)  Identify  variations  in  checklist  use  that  can  be  attributed  to  crewmember  characteristics; 

5)  Identify  procedures  or  design  changes  that  could  be  used  to  promote  error-free  checklist  use. 

1.  LAYOUT  AND  DESIGN  QF  CHECKLISTS 


1.1  Types  of  checklists  you  have  used  (please  check  types  used  and  circle  type  currently  used). 

currently  used 


a.  Paper  checklist 

b.  Laminated  card(s)  £2 

c.  Electronic  (CRT)  1 

*  Docs  the  display  replace 
another  display,  such  as 
weather  radar 

d.  Mechanical  scroll  1 

e.  Mechanical  pointer 

f.  Mechanical  slide 

g.  Toggle  switch/annunciator  light 

combination 

h.  Have  you  used,  or  do  you  now  use, 

a  mix  of  the  above  (i.e.,  -  paper 
checklist  &  mechanical  slide) 

•  If  "yes,*  are  the  "normal" 
checklists  segregated  from  the 
"emergency"  and  "abnomud"  lists 

(please  explain  in  what  way) _ 


Yes  74 
Yes  §2 
Yes  g 


Yes  4 
Yes  22 
Yes  8 
Yes  8 


No  21 
NoU 
No  88 


No  1 
No  82 
No  85 
No  88 


Yes  ®  No£l 


Yes  12  No  74 


Yes  Ifi  No  8 


i.  Do  you  see  an  advantage  to  a  mix 

of  checklist  types?  Yes  11  No  77 

(please  explain) _ 

1.2  Does  the  "silent"  checklist  have  a 

place  in  airline  cockpits?  Yes  71  No  23 

1.3  Of  the  following  checklists,  which  do  you  feel  should  be  "challeuge/response-'  and  which  should  be 
"silent"? 


challenge/ response 

silent 

Airplane  acceptance 

u 

22 

Before  start 

71 

2 

Before  taxi 

$1 

l£ 

Before  takeoff 

28 

8 

Climb 

15 

88 

Cruise 

12 

64 

Descent/In  range 

£ 

22 

Before  landing 

22 

2 

After  landing 

21 

22 

Securing 

21 

24 

1.4  The  following  questions  pertain  only  to  those  who  have  used  electronic  (CRT)  checklists  and  paper 
checklists  and  will  attempt  to  ascertain  the  relative  advantages  and  disadvantages  of  the  two  types.  Please 
circle  the  appropriate  answer. 

a.  Easier  to  use  in  all  conditions  of  cockpit 

illumination 

8  CRT  paper  8 

b.  Greater  susceptibility  to  skipping  items 

1  CRT  paper  J 

c.  Easier  to  get  at  and  use 

d.  Ease  of  use  in  different  operating  conditions 

5  CRT  paper  1 

•  Stationary  on  the  ground 

5  CRT  paper  1 

•  Moving  on  the  ground 

j  CRT  paper  1 

•  Airborne 

5  CRT  paper  I 

e.  More  heads -down  time  required 

J  CRT  paper  2 

f.  Quicker  to  use 

g.  If  items  are  skipped  and  returned  to  (such  as 
in  taxiing  without  all  engines  operating), 

5  CRT  paper  1 

which  is  easier  to  use? 

4  CRT  paper  2 

1.5  If  a  checklist  response  is  written  'as  required’  do  you  answer  with 

a.  A  known  value  (i.e.  -  flaps...  15°)? 

Yes  22  No  5 

b.  "As  required”? 

Yes  If  No  ^ 

1.6  Please  indicate  your  feelings  on  the  design  of  checklists  you  currently  use. 

a.  List  is  too  long 

Yes  12  No® 

b.  List  doesn’t  cover  enough 

Yes  lfl  No  7#« 

c.  Print  is  too  small 

Yes  f  No  §4 

d.  Easy  to  skip  items  unintentionally 

Yes  2f  No  f4 

e.  Dimensions  of  list  are  too  large 

Yes  No  78 

f.  Convenient  to  use 

Yes  7fi  No  If 

g.  Easy  to  use  at  night 

»  Is  there  sufficient  supplementary 

Yes  f8  No  31 

lighting  to  make  it  readily  visible? 
h.  Organized  in  a  manner  that  promotes  a  smooth 

Yes  fi2  No  14 

flow  pattern 

i.  Organized  in  a  maimer  that  reflects  standard 

Yes  78  No  28 

'  operating  procedure  for  the  company 

Yes  86  No  2 

j.  Convenient  place  to  stow  the  lists 

Yes  22  No  12 

k.  Easy  to  locate  ’emergency’  lists  when  needed 

l.  Do  you  feel  that  the  checklist  workload  is 

Yes  58  No  21 

equally  distributed  among  all  crewmembers? 

Yes  78  No  12 

m.  Any  other  comments 

12.  INTERRUPTIONS  TO  CHECKLIST  USE 

2. 1  Please  indicate  on  a  scale  of  I  to  10  (with  10  being  the  highest),  which  of  the  following  activities  tend 
most  to  disrupt  good  checklist  procedures.  If  they  are  particularly  disruptive  at  one  or  another  phase  of 
operation,  please  indicate  at  which  phasefs)  -  (i.e.,  ground,  climb,  cruise,  descent,  or  approach  and  landing). 


(RANK) 
score  phasetst 

a.  Ground  personnel  communications  5. 05(21 _ 

b.  Company  radio  3.06(71  _ _ 

c.  Flight  attendant  requests  4^4  (3)  J _ 

d.  ATC  communications  5;4  (1) _ 

e.  Crew  conversations  2  A  (9) _ 

f.  Navigation  requirements  2^4  (9)  _ _ 

g.  External  taxiing  distractions  4.25(41 _ 

h.  Configuring  aircraft  for  departure  2.09(101 _ 

i.  External  inflight  distractions  2.82(81  _____ 

j.  Configuring  aircraft  for  approach  3.27(61 _ 

k.  Aircraft  abnormalities  4.06(51 _ 

l.  Any  others _ 
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2.2  Do  you  feel  there  are  times  when  the  use  of  s 

checklist  is  disruptive  to  good  operating  procedures?  Yes  }1  No  58 

(If  "Yec,“  plesae  explain) _ 


2.3  What  percent  of  the  time  is  the  'Sterile  Cockpit*  concept,  below  10,000  ft.,  adhered  to  by  your  airline’s 

crews? 

a.  100%  of  the  time  21 

b.  75%  of  the  time 

c.  50%  of  the  time 

d.  less  than  50%  of  the  time  12 

3.  DEGREE  TO  WHICH  PROCEDURES  ARE  DEFINED  IN  PILOT  HANDBOOKS 

3.1  Is  a  standardized  method  for  the  use  of 
checklists  spelled  out  in  your  company 
operating  manual? 

3.2  If  so,  do  most  of  the  crews  adhere  to 
the  prescribed  method? 

3.3  Do  you  think  the  prescribed  method  could 
be  improved  upon? 

•  How? _  _ 


4.  VARIATIONS  IN  CHECKLIST  USE  ATTRIBUTABLE  TO  CREWMEMBER  CHARACTERISTICS 

4.1  Do  the  individual  crewmembers  have  any  influence 

on  the  manner  in  which  a  checklist  is  performed?  Yes  $2  No  22 

4.2  If  so,  does  this  result  in  variations,  from  one 
crew  to  another,  in  the  way  in  which  the  checklists 

are  performed?  Yes  £2  No  24 

4.3  Does  the  influence  of  the  individual  crewmembers 
sometimes  result  in  the  checklists  not  being 
performed,  or  being  performed  in  other  than  the 

prescribed  manner?  Yes  41  No  53 

4.4  Any  comments _ 


Yes  &  No  $ 
Yes  85  No  I 
Yes  42  No  44 
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5.1  Do  you  have  a  personal  "must  check*  list  that 
you  check  regardless  of  how  the  formal  checklists 
are  accomplished  (such  as  the  old  "GUMP"  list)? 

•  When  do  you  use  it? _ 

5.2  Do  you  feel  this  sort  of  list  would  be  useful  to 
all  front-end  crews? 

5.3  Do  you  have  specific  checklists  to  cover  undone  items 
(such  as  for  starting  engines  after  a  single-engine  taxi)? 

5.4  If  5.3  is  'No,*  what  do  you  use  for  memory  jogs  to  assure 
completion  of  checklist  items? 

•  Coffee  cup  over  the  flap  handle 

•  Checklist  between  the  throttles 

•  Go  through  the  list  again 

•  Other  (please  specify) _ 


5.5  Are  your  checklist  procedures  such  that  you  find 
yourself  reading  checklists  during  periods  of 
otherwise  high  workload  (i.e.,  taxiing  in  ORD, 
given  a  runway  change  in  the  middle  of  a  tight 
approach,  etc.)? 

5.6  If  5.5  is  "Yes,"  do  you 

•  Stop  the  list  until  if  becomes  less  busy? 


•  Press  on  and  hope  that  nothing  gets  missed? 

5.7  Do  crews  for  the  different  aircraft  types  in  your 
airline’s  inventory  follow  the  same  standard 
procedures  for  checklist  use? 

•  Under  what  conditions  do  they  not? 


Yes  55  No  22 


Yes  44  No  42 


Yes  25  No  52 


Yes  14  No  58 
Yes  28  No  25 
Yes  45  No  28 


Yes  5fi  No  28 


Yes  42  No  14 
(some  answered  'yes* 
to  both) 

Yes  18  No2Z 


Yes  85  No  5 


6.1  Create  a  core  checklist,  to  be  used 

industrywide,  with  variations  by  aircraft 

type  and  operating  environment  Yes  22  No  52 


6.2  Use  of  automated  checklists  wherever  possible  Yes  44  No  31 


6.3  No  use  of  checklists  on  the  ground  when 

the  aircraft  is  moving  Yes  27  No  £§ 


6.4  Use  of  color  coding  for  easy 

identification  of  checklists  Yes  77  No  12 


6.5  On  paper  checklists,  use  larger  print 

fi  or  better  letter  spacing,  or  both  Yes  42  No  22 


6.6  Use  a  mechanical  marker  to  mark 

checklist  progress  Yes  24  No  £5 
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7.  If  you  have  anv  suggestions  or  comments  for  improving  checklist  presentation,  or  a  means  of  assuring  that 
checklists  are  done  in  their  entirety,  please  explain  them. 


8.  BACKGROUND  INFORMATION  (Average  data  shown) 

The  following  information  will  be  used  anonymously  to  help  the  survey  team  evaluate  the  data  received. 
8.1.  Experience  flying  transport  aircraft 
*■  Types  _JL82 _ 

b.  Hours  in  type _ 

c.  Seats  flown 


8.2  Experience  flying  other  sophisticated  aircraft 

a.  Types_^ _ 

b.  Hours  m  type _ 

c.  Seats  flown  _ 


8. 3  Hours  in  each  seat  collectively 

a.  Captain  4140 

b.  First  Officer  5570 

c.  Second  Officer  2910  (of  these,  22  had  no  2nd  officer  time.) 

8.4  Aircraft  and  seat  currently  flown _ 

8.5  Age  45.78  (ranged  from  31-66) 

8.6  Sex  Male  £4 

8.7  Visual  correction 

a.  None 

b.  Nearsighted 

c.  Farsighted 

d.  Other _ 


Female 

1  (32  yr.  old  DC-9  Capt.) 

Yes 

No 

Yes 

No 

Yes 

No 

e.  Do  you  use  corrective  lenses  while 
flying 

•  single  focal 

•  bifocal 

•  trifocal 

•  top-and-bottom  focal 


Yes  M 

Yes _ 

Yes _ 

Yes 

Yes 


No  £1 

No _ 

No _ 

No 

No 


8.8  Does  your  company  have  a  specific  policy 

on  cockpit  resource  management?  Yes  $3  No 

8.9  If  so,  do  most  of  the  Captains 

adhere  to  the  policy?  Yes  52  No  12 


•  If  not,  do  they  basically  adhere 
to  Captain’s  autonomy? 


Yes  22  No  J 


THANK  YOU  FOR  YOUR  TIME 
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